Compare commits

..
85 Commits
Author SHA1 Message Date
armistace 806d5d0bd5 Merge pull request 'Human Edits to MCP and Ollama' (#17) from mcp_and_ollama__local_assistant_is_close into master
Build and Push Image / Build and push image (push) Successful in 11m7s
Reviewed-on: #17
2025-07-24 13:35:50 +10:00
armistace c44fa4871e Human Edits to MCP and Ollama 2025-07-24 13:35:06 +10:00
armistace 3b7a9b0547 Merge pull request 'mcp_and_ollama__local_assistant_is_close' (#16) from mcp_and_ollama__local_assistant_is_close into master
Build and Push Image / Build and push image (push) Successful in 10m6s
Reviewed-on: #16
2025-07-24 12:36:10 +10:00
armistace 32dee67aa1 Update Typo in previous Post 2025-07-24 12:34:39 +10:00
armistace 77a563f5d3 Human Edits to MCP and Ollama 2025-07-24 12:31:05 +10:00
armistace 96e93ae225 Human Edits to MCP and Ollama 2025-07-24 12:27:55 +10:00
armistace 568857fe06 Human Edits to MCP and Ollama 2025-07-24 12:27:18 +10:00
armistace 64b5a6b36a Human Edits to MCP and Ollama 2025-07-24 12:26:33 +10:00
armistace 9f07ffce80 Human Edits to MCP and Ollama 2025-07-24 12:25:55 +10:00
Blog Creator 46c1e17be0 'MCP, Ollama: Local AI Arriving Now' 2025-07-24 00:51:29 +00:00
armistace 7afa7eaf46 Merge pull request 'recovering_an_archlinux_qemu_vm_in_proxmox' (#15) from recovering_an_archlinux_qemu_vm_in_proxmox into master
Build and Push Image / Build and push image (push) Successful in 10m59s
Reviewed-on: #15
2025-07-01 17:12:23 +10:00
armistace b5267eb3ac Human edit and pelican metadata 2025-07-01 17:12:06 +10:00
Blog Creator 9b9863c230 'Recovered VM: Chroot, Pacman, and Pain
'
2025-07-01 06:45:41 +00:00
armistace 9b7ccfb244 new kub config
Build and Push Image / Build and push image (push) Failing after 6m23s
2025-07-01 14:21:09 +10:00
armistace d9b402b2c6 Merge pull request 'matrix_ai_integrations_with_baibot' (#14) from matrix_ai_integrations_with_baibot into master
Build and Push Image / Build and push image (push) Successful in 10m21s
Reviewed-on: #14
2025-06-30 17:18:13 +10:00
armistace ace2b3e98b Update with Human Interactions 2025-06-30 17:17:46 +10:00
Blog Creator ddf9ccd9aa 'LLMs, Matrix, Baibot, Home Automation, Fun' 2025-06-30 07:00:05 +00:00
Blog Creator 7e91a5d28f 'Integrate, Matrix, AI, Baibot, Locally' 2025-06-30 04:04:35 +00:00
Blog Creator 24b5477e4f 'LLM Matrix bot integration deployed' 2025-06-27 06:22:56 +00:00
armistace e3bad5a747 Typos and updates
Build and Push Image / Build and push image (push) Successful in 15m44s
2025-06-24 15:59:15 +10:00
armistace 33b6d70c95 Merge pull request 'the_failing_social_media_ban' (#13) from the_failing_social_media_ban into master
Build and Push Image / Build and push image (push) Successful in 15m19s
Reviewed-on: #13
2025-06-24 14:39:37 +10:00
armistace a260345f9b Going to try for this one 2025-06-24 14:39:20 +10:00
armistace 891158cc46 Update src/content/the_failing_social_media_ban.md 2025-06-24 14:30:54 +10:00
Blog Creator 51fc161e37 'Ban failed, tech doomed, parents empowered.' 2025-06-24 04:24:56 +00:00
Blog Creator a378000602 'Add blog post: Understanding API Rate Limits' 2025-06-24 03:41:53 +00:00
Blog Creator 3bf1cfc297 'Standardize blog post formatting template' 2025-06-24 02:55:56 +00:00
Blog Creator c01825ecad 'Standardize blog post format template.' 2025-06-24 02:27:18 +00:00
Blog Creator c3db42b803 'Add guide sustainable gardening practices' 2025-06-24 02:00:19 +00:00
Blog Creator 68af58809f 'Ban ineffective, advocate parental controls' 2025-06-23 23:34:02 +00:00
Blog Creator f1dc3e511e 'Ban ineffective, parents know best.' 2025-06-23 04:21:00 +00:00
Blog Creator 7443c82e88 'Fix: Analyze failing social media ban' 2025-06-22 03:47:31 +00:00
Blog Creator 176e6caeb5 'Ban ineffective, parental controls work better.' 2025-06-20 03:47:45 +00:00
armistace 307146b763 typo 2025-06-20 11:43:42 +10:00
armistace ab8ad6ffae Human edits to the AI draft 2025-06-20 11:42:40 +10:00
Blog Creator 2cda84da5e 'Fix: Ban flawed, focus on education' 2025-06-20 01:17:04 +00:00
armistace 2905c2917f Update src/content/when_to_use_ai.md
Build and Push Image / Build and push image (push) Successful in 18m18s
2025-06-06 13:33:36 +10:00
armistace ec0798dff2 Update for clarity of the AI response
Build and Push Image / Build and push image (push) Has been cancelled
2025-06-06 13:32:19 +10:00
armistace f41dbc802e Merge pull request 'when_to_use_ai' (#12) from when_to_use_ai into master
Build and Push Image / Build and push image (push) Successful in 11m27s
Reviewed-on: #12
2025-06-06 12:31:58 +10:00
armistace e7f996306f Human edit and update 2025-06-06 12:30:42 +10:00
Blog Creator 22c521293f 'Clarify AI usage scenarios effectively.' 2025-06-06 02:28:07 +00:00
Blog Creator 74f8c8607b 'Add clarity on AI limitations.' 2025-06-06 01:57:04 +00:00
armistace 8c342d994e fix conflicts 2025-06-06 11:32:25 +10:00
Blog Creator bcc41ed4c3 '```
git commit -m "AI: Know when to use it"
```

**Explanation of the commit message:**

*   **Concise:** It's short and to the point, adhering to the common 5-word limit.
*   **Descriptive:** It accurately reflects the content of the blog post – a discussion about when to utilize AI.
*   **Action-oriented:**  Implies a need for thoughtful consideration.
'
2025-06-06 11:30:38 +10:00
Blog Creator fc48d9a4fd '```
feat: Add blog post on AI usage scenarios
```'
2025-06-06 11:30:03 +10:00
Blog Creator 191805461d '```
feat: Add blog post on AI usage scenarios
```'
2025-06-06 11:29:09 +10:00
Blog Creator c2142f7f63 '```
git commit -m "AI: Know when to use it"
```

**Explanation of the commit message:**

*   **Concise:** It's short and to the point, adhering to the common 5-word limit.
*   **Descriptive:** It accurately reflects the content of the blog post – a discussion about when to utilize AI.
*   **Action-oriented:**  Implies a need for thoughtful consideration.
'
2025-06-06 11:28:17 +10:00
Blog Creator 9c92d19943 '```
feat: Add blog post on AI usage scenarios
```'
2025-06-06 11:27:23 +10:00
armistace aead9151c0 Update src/content/when_to_use_ai.md 2025-06-06 11:26:13 +10:00
armistace 14636a4d3b update so pelican can use - must remember 2025-06-06 11:26:12 +10:00
armistace d6d6f1893e stray w 2025-06-06 11:25:43 +10:00
armistace abf6f3feda fix push settings 2025-06-06 11:25:43 +10:00
armistace 7a4d06bbef cleanup of kube stuff 2025-06-06 11:25:43 +10:00
armistace efad73a1a4 wrap the password 2025-06-06 11:25:43 +10:00
armistace 50af2eccb3 kube pipeline manual step and kubectl yaml 2025-06-06 11:25:43 +10:00
armistace e9a7daf5b3 Change workflow push to master only 2025-06-06 11:25:43 +10:00
armistace eac2f648c0 Update src/content/when_to_use_ai.md
Build and Push Image / Build and push image (push) Successful in 7m30s
2025-06-06 10:29:51 +10:00
armistace 79d53d3462 update so pelican can use - must remember
Build and Push Image / Build and push image (push) Successful in 7m23s
2025-06-06 10:17:13 +10:00
armistace 6dd6e92d93 Merge pull request 'stray -' (#11) from kube_deployment into master
Build and Push Image / Build and push image (push) Successful in 7m41s
Reviewed-on: #11
2025-06-06 10:00:37 +10:00
armistace 3db9f63246 stray w 2025-06-06 09:59:47 +10:00
armistace 6552ba503b Merge pull request 'fix push settings' (#10) from kube_deployment into master
Build and Push Image / Build and push image (push) Failing after 6m1s
Reviewed-on: #10
2025-06-06 09:53:14 +10:00
armistace 202c787f19 fix push settings 2025-06-06 09:52:38 +10:00
armistace 61324ff499 Merge pull request 'kube_deployment' (#9) from kube_deployment into master
Build and Push Image / Build and push image (push) Failing after 9m24s
Reviewed-on: #9
2025-06-06 09:32:18 +10:00
armistace 859c40c55c cleanup of kube stuff 2025-06-06 09:31:43 +10:00
armistace 92dd043b35 wrap the password 2025-06-06 09:29:24 +10:00
armistace 761265a467 kube pipeline manual step and kubectl yaml 2025-06-06 09:25:31 +10:00
armistace da1bfd4779 Change workflow push to master only
Build and Push Image / Build and push image (push) Successful in 10m7s
2025-06-04 20:10:41 +10:00
Blog Creator 1f4b7100bc '```
Build and Push Image / Build and push image (push) Has been skipped
git commit -m "AI: Know when to use it"
```

**Explanation of the commit message:**

*   **Concise:** It's short and to the point, adhering to the common 5-word limit.
*   **Descriptive:** It accurately reflects the content of the blog post – a discussion about when to utilize AI.
*   **Action-oriented:**  Implies a need for thoughtful consideration.
'
2025-05-30 07:43:58 +00:00
Blog Creator 3ed8f91303 '```
Build and Push Image / Build and push image (push) Has been skipped
feat: Add blog post on AI usage scenarios
```'
2025-05-30 07:18:43 +00:00
armistace 49167ee308 Merge pull request 'when_to_use_ai' (#8) from when_to_use_ai into master
Build and Push Image / Build and push image (push) Successful in 5m59s
Reviewed-on: #8
2025-05-30 16:28:20 +10:00
armistace b9210910f5 Had to make a new one and this looked better
Build and Push Image / Build and push image (push) Has been skipped
2025-05-30 16:27:36 +10:00
Blog Creator 040d90ce73 '```git
Build and Push Image / Build and push image (push) Has been skipped
git commit -m "AI: Know when to apply it"
```

**Explanation of the commit message:**

*   **Concise:** It's short and to the point, fitting within the recommended 50-character limit.
*   **Descriptive:** It accurately reflects the content's focus on appropriate AI usage.
*   **Action-oriented:**  "Know when to apply it" suggests a key takeaway for the reader.
'
2025-05-30 06:20:58 +00:00
armistace 70c1dfdbb2 Merge pull request 'when_to_use_ai' (#7) from when_to_use_ai into master
Build and Push Image / Build and push image (push) Successful in 9m32s
Reviewed-on: #7
2025-05-30 15:17:31 +10:00
armistace f5b370e048 update for formatting error
Build and Push Image / Build and push image (push) Has been skipped
2025-05-30 15:16:26 +10:00
armistace 678d7f4308 Added human intro to "when to use ai"
Build and Push Image / Build and push image (push) Has been skipped
2025-05-30 15:15:35 +10:00
Blog Creator f3582e5881 '```git
Build and Push Image / Build and push image (push) Has been skipped
git commit -m "Analyze AI use cases and limitations"
```
'
2025-05-30 05:08:43 +00:00
Blog Creator 74fb66d81e '```
Build and Push Image / Build and push image (push) Has been skipped
When to use #AI carefully
```'
2025-05-30 04:55:07 +00:00
Blog Creator 874df3c8c3 '```
Build and Push Image / Build and push image (push) Has been skipped
Add blog post on AI usage scenarios
```'
2025-05-30 04:46:10 +00:00
Blog Creator 2280630149 'Sure, here's your requested 5-word commit message for the blog post:
Build and Push Image / Build and push image (push) Has been skipped
"AI vs Traditional: When & Why?"'
2025-05-30 04:30:27 +00:00
Blog Creator 9b440b775a '# Commit Message
Build and Push Image / Build and push image (push) Has been skipped
When to use AI: Structured Tasks vs Complex Decisions 🤖🔍📊

<|end_of_solution|>'
2025-05-30 01:03:18 +00:00
Blog Creator 1de70f3e48 '**Commit Message:**
Build and Push Image / Build and push image (push) Has been cancelled
When to use AI: Exploring Scenarios Where Human Expertise Still Shines Over LLMs 🚀

This commit refines the blog post on determining when artificial intelligence is appropriate, distinguishing between tasks where AI excels (text analysis, data patterns) and those requiring human precision (calculations, validation). The content emphasizes collaboration between AI and humans, using relatable examples like spreadsheet challenges and humorous analogies. Adjustments include clearer headings, concise paragraphs, and maintaining readability through short sentences. Humor is preserved to engage the audience effectively. 🚀✨

**Changes Made:**
- Updated "shudders" project explanation for clarity.
- Enhanced precision in AI limitations (mathematical accuracy vs. LLMs).
- Streamlined text interpretation triumph section with examples.
- Adjusted data cleaning conundrum to focus on preprocessing nuances.
- Finalized bottom line with actionable guidelines and closing humor.

**Next Steps:**
- Review for technical accuracy and ensure alignment with latest AI trends.
- Incorporate reader feedback from initial drafts into the final post.
- Optimize SEO keywords related to AI use cases for broader reach.

**Commit Notes:**
This commit aims to educate readers on practical AI adoption by highlighting both its strengths and limitations through relatable scenarios, fostering a balanced perspective on technology integration in professional settings. 🚀

<|end_of_solution|>'
2025-05-30 00:34:53 +00:00
armistace 8f50570084 Human edit to AI written draft
Build and Push Image / Build and push image (push) Waiting to run
game some context.. also was a bit of a mistake I think
2025-05-30 10:22:08 +10:00
Blog Creator 57502673de '# Commit Message: When to use AI - Fuzzy Logic & Context vs Precision Tasks
Build and Push Image / Build and push image (push) Has been cancelled
This commit adds a detailed blog post on determining when to employ AI, focusing on scenarios where AI excels (fuzzy matching, NLP) versus situations requiring human oversight (precision tasks). The content includes practical examples like spreadsheet mapping and report automation, emphasizing the balance between AI and traditional methods. Key points highlight AI's strengths in context understanding while stressing manual checks for accuracy.

**Changes Made:**
- Expanded explanations with relatable examples.
- Integrated humor to engage readers.
- Structured scenarios clearly (work orders, reports) for clarity.

<|end_of_solution|>'
2025-05-29 23:52:25 +00:00
armistace aeb05e6df4 Merge pull request 'production typos' (#6) from first_ai_post into master
Build and Push Image / Build and push image (push) Successful in 6m57s
Reviewed-on: #6
2025-01-21 21:32:12 +10:00
armistace 515fd10869 Merge pull request 'updates with deepseek' (#5) from first_ai_post into master
Build and Push Image / Build and push image (push) Successful in 6m29s
Reviewed-on: #5
2025-01-21 21:11:37 +10:00
armistace b7097527e5 Merge pull request 'first ai blog post...sort of' (#4) from first_ai_post into master
Build and Push Image / Build and push image (push) Successful in 6m36s
Reviewed-on: #4
2025-01-21 17:41:09 +10:00
9 changed files with 538 additions and 34 deletions
+53 -34
View File
@@ -1,42 +1,61 @@
name: Build and Push Image name: Build and Push Image
on: [ push ] on:
push:
branches:
- master
jobs: jobs:
build: build:
name: Build and push image name: Build and push image
runs-on: ubuntu-latest runs-on: ubuntu-latest
container: catthehacker/ubuntu:act-latest container: catthehacker/ubuntu:act-latest
if: gitea.ref == 'refs/heads/master' if: gitea.ref == 'refs/heads/master'
steps: steps:
- name: Checkout - name: Checkout
uses: actions/checkout@v4 uses: actions/checkout@v4
- name: Create Kubeconfig - name: Create Kubeconfig
run: | run: |
mkdir $HOME/.kube mkdir $HOME/.kube
echo "${{ secrets.KUBEC_CONFIG_BUILDX }}" > $HOME/.kube/config echo "${{ secrets.KUBEC_CONFIG_BUILDX_NEW }}" > $HOME/.kube/config
- name: Set up Docker Buildx - name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3 uses: docker/setup-buildx-action@v3
with: with:
driver: kubernetes driver: kubernetes
driver-opts: | driver-opts: |
namespace=gitea-runner namespace=gitea-runner
qemu.install=true qemu.install=true
- name: Login to Docker Registry - name: Login to Docker Registry
uses: docker/login-action@v3 uses: docker/login-action@v3
with: with:
registry: git.aridgwayweb.com registry: git.aridgwayweb.com
username: armistace username: armistace
password: ${{ secrets.REG_PASSWORD }} password: ${{ secrets.REG_PASSWORD }}
- name: Build and push - name: Build and push
uses: docker/build-push-action@v5 uses: docker/build-push-action@v5
with: with:
context: . context: .
push: true push: true
platforms: linux/amd64,linux/arm64 platforms: linux/amd64,linux/arm64
tags: | tags: |
git.aridgwayweb.com/armistace/blog:latest git.aridgwayweb.com/armistace/blog:latest
- name: Deploy
run: |
echo "Installing Kubectl"
apt-get update
apt-get install -y apt-transport-https ca-certificates curl gnupg
curl -fsSL https://pkgs.k8s.io/core:/stable:/v1.33/deb/Release.key | gpg --dearmor -o /etc/apt/keyrings/kubernetes-apt-keyring.gpg
chmod 644 /etc/apt/keyrings/kubernetes-apt-keyring.gpg
echo 'deb [signed-by=/etc/apt/keyrings/kubernetes-apt-keyring.gpg] https://pkgs.k8s.io/core:/stable:/v1.33/deb/ /' | tee /etc/apt/sources.list.d/kubernetes.list
chmod 644 /etc/apt/sources.list.d/kubernetes.list
apt-get update
apt-get install kubectl
kubectl delete namespace blog
kubectl create namespace blog
kubectl create secret docker-registry regcred --docker-server=${{ vars.DOCKER_SERVER }} --docker-username=${{ vars.DOCKER_USERNAME }} --docker-password='${{ secrets.DOCKER_PASSWORD }}' --docker-email=${{ vars.DOCKER_EMAIL }} --namespace=blog
kubectl apply -f kube/blog_pod.yaml && kubectl apply -f kube/blog_deployment.yaml && kubectl apply -f kube/blog_service.yaml
+24
View File
@@ -0,0 +1,24 @@
apiVersion: apps/v1
kind: Deployment
metadata:
name: blog-deployment
labels:
app: blog
namespace: blog
spec:
replicas: 3
selector:
matchLabels:
app: blog
template:
metadata:
labels:
app: blog
spec:
containers:
- name: blog
image: git.aridgwayweb.com/armistace/blog:latest
ports:
- containerPort: 8000
imagePullSecrets:
- name: regcred
+13
View File
@@ -0,0 +1,13 @@
apiVersion: v1
kind: Pod
metadata:
name: blog
namespace: blog
spec:
containers:
- name: blog
image: git.aridgwayweb.com/armistace/blog:latest
ports:
- containerPort: 8000
imagePullSecrets:
- name: regcred
+13
View File
@@ -0,0 +1,13 @@
apiVersion: v1
kind: Service
metadata:
name: blog-service
namespace: blog
spec:
type: NodePort
selector:
app: blog
ports:
- port: 80
targetPort: 8000
nodePort: 30009
@@ -0,0 +1,114 @@
Title: Integrating Ollama and Matrix with Baibot
Date: 2025-06-25 20:00
Modified: 2025-06-30 08:00
Category: AI, Data, Matrix
Tags: ai, kubernetes, matrix
Slug: ollama-matrix-integration
Authors: Andrew Ridgway
Summary: Integrating a Local LLM to a personal matrix server all the fun AND data sovereignty
### _Human Introduction_
I've been experimenting with AI and integrations I'm particuarly excited by the idea of using LLM's to integrate between different systems (Stay tuned for a blog [MCP](https://modelcontextprotocol.io/introduction) at some point in the future!)
Below I've thrown together some notes and had AI build a very quick how to on a cool little project that took next to no time to put together that I thought might be interesting for the group.. Enjoy!
# Matrix AI Integrations with baibot: A Fun Journey into Home Automation and LLMs
Alright, so I’ve been messing around with this cool project called **baibot**, which is a locally deployable bot for integrating Large Language Models (LLMs) into Matrix chatrooms. If you’re anything like me, you run your own Matrix server to keep things private and under control—whether it’s for family communication or interacting with the tech community. But one day, I thought, “Why not have my LLMs right where I’m already managing everything else?” Enter baibot.
**Setting Up My Own Matrix Server with baibot**
First off, I’ve got a home Matrix server running Element. Integrating baibot into this environment makes sense because it allows me to connect directly via the same platform. The key was getting the configuration right using examples from [baibot’s GitHub](https://github.com/etkecc/baibot/blob/main/docs/sample-provider-configs/ollama.yml). For instance, connecting to an Ollama gemma3 model with a specific prompt ensures it’s lighthearted yet responsive:
```yaml
base_url: http://<my_ollama_ip>:11434/v1
text_generation:
model_id: gemma3:latest
prompt: 'You are a lighthearted bot...'
temperature: 0.9
max_response_tokens: 4096
max_context_tokens: 128000
```
This gives me precise control over the bot’s behavior, ensuring each instance in Matrix rooms behaves exactly as intended.
**Deploying to Kubernetes**
To ensure reliability, I used Kubernetes. Here's a breakdown of the key files:
* **Deployment.yaml**: Manages pod replicas, security contexts, and volume mounts for persistence.
```yaml
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
app: ridgway-bot
name: ridgway-bot
spec:
replicas: 1
strategy:
type: Recreate
template:
spec:
containers:
- image: ghcr.io/etkecc/baibot:v1.7.4
name: baibot
volumeMounts:
- name: ridgway-bot-cm
mountPath: /app/config.yml
- name: ridgway-bot-pv
mountPath: /data
volumes:
- name: ridgway-bot-cm
configMap:
name: ridgway-bot
- name: ridgway-bot-pv
persistentVolumeClaim:
claimName: ridgway-bot-storage
```
* **Persistent Volume Claim (PVC)** ensures data storage for baibot.
```yaml
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: ridgway-bot-storage
spec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 500Mi
```
The deployment script handles namespace creation, config maps, PVCs, and waits for the pod to be ready before copying data.
**Integrating with OpenWebUI for RAG**
Another cool aspect is integrating baibot with **OpenWebUI**, which acts as an OpenAI-compatible API. This allows me to leverage models I’ve created in OpenWebUI that include knowledge bases (RAG). The config here uses OpenWebUI’s endpoints:
```yaml
base_url: 'https://<my-openwebui-endpoint>/api/'
api_key: <my-openwebui-api-key>
text_generation:
model_id: andrew-knowledge-base
prompt: 'Your name is Rodergast...'
```
This setup lets me access RAG capabilities directly within Matrix chats, all without writing a single line of code. It’s like having my very own AI research assistant right there in the chatroom.
**Future Steps and Challenges**
Now that baibot is up and running, I’m already thinking about expanding its use cases. The next step might be integrating it with **Home Assistant** for alarm notifications or other automation tasks. However, my current setup uses an older gaming PC, which struggles with computational demands. This could lead to a rearchitecting effort—perhaps moving to a dedicated server or optimizing the hardware.
**Conclusion**
Baibot has been a fantastic tool for experimenting with AI integrations in Matrix. By leveraging existing infrastructure and OpenWebUI’s capabilities, I’ve achieved full control over data privacy and customization. The next frontier is expanding these integrations into more practical applications like home automation. Stay tuned for updates!
**Final Thoughts**
It’s incredibly rewarding to see how open-source projects like baibot democratize AI access. Whether you’re a hobbyist or a pro, having tools that let you run LLMs locally without vendor lock-in is game-changing. If you’re interested in diving deeper, check out the [baibot GitHub](https://github.com/etkecc/baibot) and explore its documentation. Happy coding!
@@ -0,0 +1,93 @@
Title: MCP and Ollama - Local Assistant is getting nearer
Date: 2025-07-24 20:00
Modified: 2025-07-24 20:00
Category: AI
Tags: tech, ai, ollama, mcp, ai-tools
Slug: mcp-ollama-local-assistant-soon
Authors: Andrew Ridgway
Summary: An Exploration of the Model Context Protocol and its potential to revolutionise how we interact with AI
## Human Introduction
So for today's blog I've upped the model paramters on both the editors and a couple drafters.. and I have to say I think we've nailed what my meagre hardware can achieve in terms of content production. The process take 30 more minutes than before to churn now but that quality output more than makes up for it. For context we are now using:
- _Editor_: Gemma3:27b
- _Journalist 1_: phi4-mini:latest
- _Journalist 2_: phi4:latest
- _Journalist 3_: deepseek-r1:14b <-> _I know but it **is** good even if it won't talk about Tiananmen Square_
- _Journalist 4_: qwen3:14b
As you can see if you compare some of the other blogs this blog has really nailed tone and flow. Some of the content was wrong.. it thought I "wrote" [MCPO](https://github.com/open-webui/mcpo), I didn't, I wrapped it, and the sign off was very cringe but otherwise the blog is largely what came out from the editor.
As I get better hardware and can run better models, I fully see this being something that could potentially not need much editing on this side.. have to see how it goes moving forward... anyways, without futher adieu, Behold.. MCP and Ollama - A blog _**about**_ AI _**by**_ AI
## Introduction: Beyond the Buzzwords – A Real Shift in AI
For the last couple of weeks, I’ve been diving deep into **MCP** – both for work and personal projects. It’s that weird intersection where hobbies and professional life collide. Honestly, I was starting to think the whole AI hype was just that – hype. But MCP? It’s different. It’s not just another buzzword; it feels like a genuine shift in how we interact with AI. It’s like finally getting a decent internet connection after years of dial-up.
The core of this change is the **Model Context Protocol** itself. It’s an open specification, spearheaded by **Anthropic**, but rapidly gaining traction across the industry. Google’s thrown its weight behind it with [MCP Tools](https://google.github.io/adk-tools/mcp-tools/), and Amazon’s building it into [Bedrock Agent Core](https://aws.amazon.com/bedrock/agent-core/). Even Apple, with its usual air of exclusivity, is likely eyeing this space.
## What *Is* MCP, Anyway? Demystifying the Protocol
Okay, let’s break it down. **MCP** is essentially a standardized way for **Large Language Models (LLMs)** to interact with **tools**. Think of it as giving your AI a set of keys to your digital kingdom. Instead of just *talking* about doing things, it can actually *do* them.
Traditionally, getting an LLM to control your smart home, access your code repository, or even just send an email required a ton of custom coding and API wrangling. MCP simplifies this process by providing a common language and framework. It’s like switching from a bunch of incompatible power adapters to a universal charger.
The beauty of MCP is its **openness**. It’s not controlled by a single company, which fosters innovation and collaboration. It’s a bit like the early days of the internet – a wild west of possibilities.
## My MCP Playground: Building a Gateway with mcpo
I wanted to get my hands dirty, so I built a little project wrapping [**mcpo**](https://github.com/open-webui/mcpo) in a container that can pull in config to create a containerised service. It’s a gateway that connects **OpenWebUI** – a fantastic tool for running LLMs locally – with various **MCP servers**.
The goal? To create a flexible and extensible platform for experimenting with different AI agent tools within my build pipeline. I wanted to be able to quickly swap out different models, connect to different services, and see what happens. It’s a bit like having a LEGO set for AI – you can build whatever you want.
You can check out the project [here](https://git.aridgwayweb.com/armistace/mcpo_mcp_servers). If you’re feeling adventurous, I encourage you to clone it and play around. I’ve got it running in my **k3s cluster** (a lightweight Kubernetes distribution), but you can easily adapt it to Docker or other containerization platforms.
## Connecting the Dots: Home Assistant and Gitea Integration
Right now my wrapper supports two key services: **Home Assistant** and **Gitea**.
**Home Assistant** is my smart home hub – it controls everything from the lights and thermostat to the security system. Integrating it with mcpo allows me to control these devices using natural language commands. Imagine saying, “Hey AI, dim the lights and play some jazz,” and it just happens. It’s like living in a sci-fi movie.
**Gitea** is my self-hosted Git service – it’s where I store all my code. Integrating it with mcpo allows me to use natural language to manage my repositories, create pull requests, and even automate code reviews. It’s like having a personal coding assistant.
I initially built a custom **Gitea MCP server** to get familiar with the protocol. But the official **Gitea-MCP** project ([here](https://gitea.com/gitea/gitea-mcp)) is much more robust and feature-rich. It’s always best to leverage existing tools when possible.f
Bringing in new MCP servers should be as simple as updating the config to provide a new endpoint and, if using stdio, updating the build script to bring in the mcp binary or git repo with the mcp implementation you want to use.
## The Low-Parameter Model Challenge: Balancing Power and Efficiency
I’m currently experimenting with **low-parameter models** like **Qwen3:4B** and **DeepSeek-R1:14B**. These models are relatively small and efficient, which makes them ideal for running on local hardware. However, they also have limitations.
One of the biggest challenges is getting these models to understand complex instructions. They require very precise and detailed prompts. It’s like explaining something to a child – you have to break it down into simple steps.
Another challenge is managing the context window. These models have a limited memory, so they can only remember a certain amount of information. This can make it difficult to have long and complex conversations.
## The Future of AI Agents: Prompt Engineering and Context Management
I believe the future of AI lies in the development of intelligent **agents** that can seamlessly interact with the world around us. These agents will need to be able to understand natural language, manage complex tasks, and adapt to changing circumstances.
**Prompt engineering** will be a critical skill for building these agents. We’ll need to learn how to craft prompts that elicit the desired behavior from the models. Almost like coding in a way but with far less structure and no need to understand the "syntax". But we're a long way from here yet
**Context management** will also be crucial. We’ll need to develop techniques for storing and retrieving relevant information, so the models can make informed decisions.
## Papering Over the Cracks: Using MCP to Integrate Legacy Systems
At my workplace, we’re exploring how to use MCP to integrate legacy systems. Many organizations have a patchwork of different applications and databases that don’t easily communicate with each other.
MCP can act as a bridge between these systems, allowing them to share data and functionality. It’s like building a universal translator for your IT infrastructure.
This can significantly reduce the cost and complexity of integrating new applications and services, if we get the boilerplate right.
## Conclusion: The Dawn of a New Era in AI
MCP is not a silver bullet, but it’s a significant step forward in the evolution of AI. It provides a standardized and flexible framework for building intelligent agents that can seamlessly interact with the world around us.
I’m excited to see what the future holds for this technology. I believe it has the potential to transform the way we live and work.
If you’re interested in learning more about MCP, I encourage you to check out the official website ([https://modelcontextprotocol.io/introduction](https://modelcontextprotocol.io/introduction)) and explore the various projects and resources that are available.
And if you’re feeling adventurous, I encourage you to clone my mcpo project ([https://git.aridgwayweb.com/armistace/mcpo_mcp_servers](https://git.aridgwayweb.com/armistace/mcpo_mcp_servers)) and start building your own AI agents.
It's been a bit of a ride. Hopefully I'll get a few more projects that can utilise some of these services but with so much new stuff happening my 'ooo squirell' mentality could prove a bit of a headache... might be time to crack open the blog_creator and use crew ai and mcp to create some research assistants on top of the drafters and editor!
Talk soon!
@@ -0,0 +1,93 @@
Title: Recovering Archlinux Qemu VM in Proxmox
Date: 2025-07-01 20:00
Modified: 2025-07-01 20:00
Category: SysAdmin
Tags: System Admin, Proxmox, Qemu, Arch, Kubernetes
Slug: recovering-arch-vm-proxmox
Authors: Andrew Ridgway
Summary: An absolute nightmare of a day trying to recover my kube cluster from a silly update error
### Human Edit
This is probably the most amazing run of the blog creator, I've started using the new gemma3n and also upgrade the box ollama runs on so it can run slightly bigger models. Using phi4 and gemma:27b has produced some amazing results see below
I *did* need to update some of the pacman stuff as it conflated to seperate issues so bear in mind I have made some little edits in that place but otherwise... this is straight from the mouth of the llm. Enjoy!
# Recovering an Archlinux QEMU VM in Proxmox: A Day in Hell and Back Again
Well that was a morning. Today I wanted to try and fix my Longhorn installation in Kube... (again 😥). It turns out, things didn't go as planned.
## The Unexpected Downfall
I went to perform my usual update and reboot... except today for whatever reason, the upgrade decided to fail to install the kernel and left me with an unbootable system.
### Dropping into Grub Rescue
At this point I dropped back down to grub rescue mode (which is always fun). Honestly? I hate that environment! And then it hit me: these systems are just QEMU disks, right? Surely I can mount them, chroot in, and fix the install.
## The Quest for Recovery
It took 2 hours of frantic Googling through Proxmox and Arch forums until I stumbled upon something... almost magical.
### Mounting QEMU Disks Made Easy
I found an amazing suite of tools to make mounting these qemu disks a breeze. Check out this [guide](https://www.howtogeek.com/devops/how-to-mount-a-qemu-virtual-disk-image/) for all the details on libguestfs-tools and guestmount.
#### Mounting in Action
```bash
sudo apt install libguestfs-tools
sudo guestmount --add /var/lib/pve/local-btrfs/images/100/vm-100-disk-0/disk.raw --mount /dev/sda3 /tmp/kube_disk/
```
### Enter Chroot Land
Now that I've got my disk mounted, it's time to chroot in. But hold up! I need it as root this time.
#### Setting Up Arch-Chroot
```bash
sudo apt install arch-installation-scripts
arch-chroot /tmp/kube_disk/
```
### Pacman: The Hero We Deserve (But Need Permission)
Oh boy, pacman threw 23 million permission errors my way. Last year they changed it to work rootless by default… but I found out you can turn off the `DefaultUser` flag in `/etc/pacman.conf`. Here's how:
```bash
# Disable DefaultUser temporarily for this session (or remove if permanent)
pacman -Syu
```
I did have a couple issues installing the kernel (which is what got borked in the update)
```bash
# Sometimes some files got written so use overwrite to get rid of them
# be warned this *could* be destructive
pacman -S linux --overwrite "*"
```
### Clean Up and Exit
Once we're done, we need to exit the chroot. Remember that crucial step: umounting correctly.
```bash
exit
sudo umount /tmp/kube_disk/
```
## The Reboot Saga (And How Not To Do It)
Reboot was supposed to be a smooth sail… but I made one fatal mistake.
### Corruption Nightmare
I didn't unmount before starting the VM. This led me down an unfortunate path of corrupting my btrfs partition beyond recognition and having to rebuild not just my master node, but *entire* cluster! Backups saved the day... barely!
#### Lessons Learned
* **Never** reboot without first properly umounting.
* Seriously need more backups for those images. 🚀
## Conclusion: A Cluster-Fucked Day Turned Into a Learning Experience
All in all it was chaos, but hey – learning happens at 2 AM after midnight reboots and frantic Googling. Hope this helps anyone else stuck with Proxmox woes! 🚀
@@ -0,0 +1,53 @@
Title: The Failing Social Media Ban
Date: 2025-06-19 20:00
Modified: 2025-06-20 20:00
Category: Politics
Tags: politics, social meda, tech policy
Slug: social-media-ban-fail
Authors: Andrew Ridgway
Summary: The Social Media ban is an abject failure of policy. Education and the use of the much better existing tools is the key
## 🎯 The Goal: A Legal Framework to Protect Kids
The Australian government’s or should I say Julie Inman's plan to ban social media for teens has sparked on going debate. While the intention is noble—protecting minors from online risks—it’s clear the technical and legal hurdles are massive. This government concept of relying on “facial aging” or “Proof of Age” APIs are prone to privacy violations and data breaches. Parents already have tools that let them make decisions about their children’s tech use without needing to hand over photos of their ID. The governments current approach is mired in bureaucracy and the tech world does not thrive in that environment. Instead of trying to outsource the problem to consultants, the government should **educate parents on the tools already available**.
## 🧩 The Problem: Tech Giants Won’t Do It
The government’s plan to enable Inman's vision is to use facial recognition or “age-based” filters. This was flawed from the start. These systems are expensive, unreliable, and not designed for the scale of a national rollout. Even if a company like Meta or Google could do it, they’d **never** do it for the same reason: **There is no money in the equation**. The only alternative is to outsource to consultants, but those consultants are not equipped to handle the complexity. The government’s plan is a joke, no one is going to build a system that’s 100% accurate, secure, and compliant with privacy laws and those that, maybe, could have no insentive to. No amount of chest thumping by The E-Safety Commissioner will change this fact and throwing frankly meaningless pieces of paper from our legislative assembly will do little more than make them laugh
## 🛠️ The Tools Parents Already Have
Parents ([Is it parents? is it in fact fiefdom creation on behalf of Julie Inman?](https://minister.infrastructure.gov.au/rowland/media-release/record-investment-improve-safety-australians-online)) must give up on the idea of the government fixing this. , parents should be using the **tools already in their homes**. These tools are **free, secure, and effective**. Some examples include (and I use in my own home):
* **Fritz Box Parental Controls** (https://en.fritz.com/service/knowledge-base/dok/FRITZ-Box-7530/8_Restricting-internet-use-with-the-FRITZ-Box-parental-controls/) - Allows blocking of websites and apps, setting time limits, and creating user profiles.
* **Microsoft Family Safety** (https://www.microsoft.com/en-au/microsoft-365/family-safety) - Provides screen time limits, content filters, and activity reporting.
* **Nintendo Parental Controls** (https://www.nintendo.com/au/apps/parental-controls/) - Allows managing game time, content restrictions, and communication settings on Nintendo devices.
* **Google Family Link** (https://families.google.com/familylink/) - Enables remote monitoring, app management, and location tracking for children's Android devices.
* **Apple Family Sharing** (https://support.apple.com/en-au/105121) - Allows sharing purchases, subscriptions, and location information with family members.
These tools let parents **block apps, limit screen time, and monitor online activity** without needing to share sensitive data. They offer parents full control over what is available and are not dependant on some arbitrary list governed in legislation (which is in an of itself an indicator of how backwards this legislation is)
## 📚 The Real Solution: Education, Not Tech
The government’s plan is a **mistake**. Instead of trying to build a new system, parents should be **educating themselves on the tools already available**.
### 🔄 Flexibility for Every Family
* **Approved apps**
* **Blacklisted content**
* **Screen time limits**
* **Privacy controls**
These tools let parents **make decisions tailored to their children’s needs**. No one-size-fits-all approach. It gives parents autonomy over their online decision making whilst better respecting everyones privacy, including the childs. Already Julie is making calls to expand the list, this is unacceptable, it is no one but MY choice what is acceptable in my house and for my family.
## 🧩 Why the Government’s Plan Fails
The government’s plan is a **disaster**. It’s not about fixing the problems of social media use in teens, it’s about giving the perception they are doing something about it using archaic methods and tools that don't go to the root cause. The tools parents already have are **better, cheaper, and more secure**. The only way to make this work is for the government to **stop trying to solve a social problem with tech** and **focus on the real solution: education and parental autonomy**. Stop Letting Julie create her cartel and create her own version of the Chinese firewall
## 📝 Summary: The Right Tools, Not the Tech
The government’s plan is a dead monkey. Instead of trying to build a system that’s 100% accurate and secure, parents should be using the **tools already in their homes**. These tools are **free, effective, and preserve privacy**. They let parents **make decisions about their children’s tech use on a true case by case basis** without needing to hand over sensitive data.
## 🧩 Final Thoughts
The Government's plan, at the behest of Julie Inman, is a **disaster**. It’s not about fixing the problem with social media, it’s about creating the perception they are solving a problem that is already solved. [The E-Safety Commissioner has made clear her plans are to take control out of our hands when it comes to what we can do online](https://www.esafety.gov.au/newsroom/media-releases/online-industry-asked-address-esafetys-concerns-draft-codes-0#:~:text=Online%20industry%20asked%20to%20address%20eSafety%27s%20concerns%20with%20draft%20codes,-Share&text=Australia%27s%20eSafety%20Commissioner%20has%20asked,safeguards%20for%20users%20in%20Australia.) Parents should be using the **tools already in their homes**. The real solution is not to expect a government to fix this, but to **educate themselves on the tools that already exist**. Until we accept that this is our responsbility the problem will continue propogate because the only place it can be fixed is in the home and not my Julie Inam.
+82
View File
@@ -0,0 +1,82 @@
Title: When to use AI
Date: 2025-06-05 20:00
Modified: 2025-06-06 08:00
Category: AI, Data
Tags: ai, python
Slug: when-to-use-ai
Authors: Andrew Ridgway
Summary: Should we be using AI for ALL THE THINGS!?
# Human Introduction
Well.. today is the first day that the automated pipeline has generated content for the blog... still a bit of work to do including
1. establishing a permanent vectordb solution (chromadb? pg_vector?)
2. Notification to Matrix that something has happened
3. Updating Trilium so that the note is marked as blog_written=true
BUT it can take a note from trilium, generate drafts with mulitple agents, and then use RAG to have an editor go over those drafts.
I'm particularly proud of the randomness I've applied to temperature, top_p and top_k for the different draft agents. This means that each pass is giving me quite different "creativity" (as much as that can be applied to an algorithm that is essentially munging letters together that have a high probability of being together) It has created some really interesting variation for the editor to work with and getting some really interesting results.
Anyways, without further ado, I present to you the first, pipeline written, AI content for this blog
---
# When to Use AI: Navigating the Right Scenarios
Okay, so I've been getting this question a lot lately: "When should we use AI?" or even more frustratingly, "Why can't AI do this?" It's like asking when to use a hammer versus a screwdriver. Sometimes AI is the perfect tool, other times it's better left in the toolbox. Let me break down some scenarios where AI shines and where it might not be the best bet.
## The Spreadsheet Dilemma: Where AI Can help, and where it hurts
**Scenario:** Mapping work types to categories in a spreadsheet with thousands of entries, like distinguishing between "Painting," "Repainting," "Deck Painting," or "Stucco Repainting."
**Where AI Helps:**
* **Fuzzy Matching & Contextual Understanding:** AI excels at interpreting relationships between words (e.g., recognizing "Deck Painting" as a subset of "Painting"). However, traditional methods with regex or string manipulation fail here because they lack the nuanced judgment needed to handle ambiguity.
**Where AI Struggles:**
* **Precision Over Ambiguity:** Calculations requiring exact values (e.g., average durations) are better handled by deterministic algorithms rather than AI’s probabilistic approach.
**Traditional Methods Are Easier for Deterministic Problems:**
* **Formula-Based Logic:** Building precise formulas for workload analysis relies on clear, unambiguous rules. AI can’t replace the need for human oversight in such cases.
## When AI Shines: Contextual and Unstructured Tasks
**Scenario:** Automating customer support with chatbots or analyzing social media sentiment.
**Why AI Works Here:**
* **Natural Language Processing (NLP):** AI understands context, tone, and intent in unstructured data, making it ideal for tasks like chatbot responses or content analysis.
* **Pattern Recognition:** AI identifies trends or anomalies in large datasets that humans might miss, such as predictive maintenance in industrial settings.
**Why Traditional Methods Don't:**
* **There is no easily discernable pattern:** If the pattern doesn't exist in a deterministic sense there will be little someone can do without complex regex and 'whack a mole' style programming.
## Hybrid Approaches: The Future of Efficiency
While traditional methods remain superior for precise calculations, AI can assist in setting up initial parameters or generating insights. For example:
* **AI Proposes Formulas:** An LLM suggests a workload calculation formula based on historical data.
* **Human Checks Validity:** A human ensures the formula’s accuracy before deployment.
## Key Takeaways
1. **Use AI** for tasks involving:
* Unstructured data (e.g., text, images).
* Contextual understanding and interpretation.
* Pattern recognition and trend analysis.
2. **Stick to Traditional Methods** for:
* Precise calculations with deterministic logic.
* Tasks requiring error-free accuracy (e.g., financial modeling).
## Conclusion
AI is a powerful tool but isn’t a one-size-fits-all solution. Match the right approach to the task at hand—whether it’s interpreting natural language or crunching numbers. The key is knowing when AI complements human expertise rather than replaces it.
**Final Tip:** Always consider the trade-offs between precision and context. For tasks where nuance matters, AI is your ally; for rigid logic, trust traditional methods.
🚀