Compare commits

...
Author SHA1 Message Date
armistace 39e60154e7 Merge pull request 'gpt_oss__is_it_eee' (#18) from gpt_oss__is_it_eee into master
Build and Push Image / Build and push image (push) Failing after 8m8s
Reviewed-on: #18
2025-08-14 11:44:54 +10:00
armistace f7cd3f7ba7 Human edits to GPT-OSS Is it EEE
had to make some edits to the article and add the human intro
2025-08-14 11:41:46 +10:00
Blog Creator a3efb5128d 'GPT OSS: Is it EEE?
'
2025-08-13 20:35:16 +00:00
Blog Creator e06768e3d7 'GPT-OSS: Examining OpenAI's new play.
'
2025-08-12 20:37:25 +00:00
Blog Creator 6a50b1634d 'GPT-OSS: EEE concerns explored deeply.
'
2025-08-12 03:51:24 +00:00
armistace 806d5d0bd5 Merge pull request 'Human Edits to MCP and Ollama' (#17) from mcp_and_ollama__local_assistant_is_close into master
Build and Push Image / Build and push image (push) Successful in 11m7s
Reviewed-on: #17
2025-07-24 13:35:50 +10:00
armistace c44fa4871e Human Edits to MCP and Ollama 2025-07-24 13:35:06 +10:00
armistace 3b7a9b0547 Merge pull request 'mcp_and_ollama__local_assistant_is_close' (#16) from mcp_and_ollama__local_assistant_is_close into master
Build and Push Image / Build and push image (push) Successful in 10m6s
Reviewed-on: #16
2025-07-24 12:36:10 +10:00
armistace 32dee67aa1 Update Typo in previous Post 2025-07-24 12:34:39 +10:00
armistace 77a563f5d3 Human Edits to MCP and Ollama 2025-07-24 12:31:05 +10:00
armistace 96e93ae225 Human Edits to MCP and Ollama 2025-07-24 12:27:55 +10:00
armistace 568857fe06 Human Edits to MCP and Ollama 2025-07-24 12:27:18 +10:00
armistace 64b5a6b36a Human Edits to MCP and Ollama 2025-07-24 12:26:33 +10:00
armistace 9f07ffce80 Human Edits to MCP and Ollama 2025-07-24 12:25:55 +10:00
Blog Creator 46c1e17be0 'MCP, Ollama: Local AI Arriving Now' 2025-07-24 00:51:29 +00:00
armistace 7afa7eaf46 Merge pull request 'recovering_an_archlinux_qemu_vm_in_proxmox' (#15) from recovering_an_archlinux_qemu_vm_in_proxmox into master
Build and Push Image / Build and push image (push) Successful in 10m59s
Reviewed-on: #15
2025-07-01 17:12:23 +10:00
3 changed files with 180 additions and 1 deletions
+86
View File
@@ -0,0 +1,86 @@
Title: GPT OSS - Is It Embrace, Extend, Extenguish
Date: 2025-08-12 20:00
Modified: 2025-08-14 20:00
Category: Politics, Tech, AI
Tags: politics, tech, Ai
Slug: social-media-ban-fail
Authors: Andrew Ridgway
Summary: GPT OSS is here from Open AI, the first open weight model from them since GPT-2. My question is... why now?
# Human Introduction
This has been a tough one for the publishing house to get right. I've had it generate 3 different drafts and this is still the result of quite the edit. Today's blog was written by:
1. Gemma:27b - Editor
2. GPT-OSS - Journalist
3. Qwen3:14b - Journalist
4. phi4:latest - Journalist
5. deepseek-r1:14b - journalist
The big change from last time is the addition of gpt-oss, which is of course the focus of hte topic today. It's quite the open weight model, haven't played with the tooling yet but I'm exceited to see what it can do, even if I do have questions.
Anyways, without further ado! GPT-OSS is it EEE? written by AI... For AI?
# GPT OSS - Is It EEE?
## Introduction: The Return of OpenAI (With Some Questions)
This week, the AI world got a bit busier than usual. OpenAI dropped their [**GPT-OSS**](https://openai.com/index/introducing-gpt-oss/) models, and it feels like they’re trying to make up for lost time—or maybe just remind everyone that they’re still in the game. The release has sparked a lot of excitement, but also some confusion. Are these models really as good as they claim? And why now? Let’s break this down with all the drama, intrigue, and a dash of humor you’ve come to expect from your friendly neighborhood tech writer.
## What Exactly Is GPT-OSS Anyway?
OpenAI has thrown two models into the ring:
1. **GPT-oss-120b**: A hefty 120 billion parameter model that they’re claiming can “hold its own” against their own **o4-mini** (which is *incredibly* expensive to run). The kicker? It apparently does this on a single 80GB GPU. That’s impressive if true, but let’s not get carried away just yet.
2. **GPT-oss-20b**: The smaller sibling that’s currently helping me draft this very blog post. OpenAI says it’s on par with their **o3-mini** and can run on a measly 16GB of memory. That makes it perfect for edge devices, local inference, or when you don’t want to spend your life savings on cloud credits.
Both models are also supposed to be ace at tool use, few-shot function calling, CoT reasoning, and even health-related tasks—outperforming some proprietary models like GPT-4 in certain cases. Impressive? Sure. But let’s not forget that OpenAI has a history of making bold claims.
## The Great AI Model Exodus: Why We’re Here
Over the past year or so, the AI community has been moving away from GPT-based models—not because they were bad (they weren’t), but because they were closed-source and expensive to use at scale. Developers wanted more control, transparency, and affordability. Enter the rise of open-source and open-weight models like:
* **Google’s Gemini (Gemma)** series
* **Microsoft’s Phi** series (yes, that Microsoft—ironically, OpenAI is a subsidiary)
* The **Qwen** series
* And others like **Llama** and **Deepseek**
These models have been a breath of fresh air for developers. They’re free to use, tweak, and integrate into projects without worrying about pesky API limits or astronomical costs. It’s like the AI world finally got its own version of Linux—except with neural networks. But then OpenAI showed up with GPT-OSS. And now everyone is asking: Why?
## Is This an Embrace-Extend-Extinguish Play?
Ah, the classic **Embrace, Extend, Extinguish** strategy. If you’re not familiar, it’s a business tactic where a company adopts (embrace) an existing standard or technology, extends it with their own features, and then slowly extinguishes the competition by making their version incompatible or superior.
Now, I’m not accusing OpenAI of anything here—just pointing out that they’re a Microsoft subsidiary, and Microsoft has a history of such strategies. Whether this is intentional or just good business sense is up for debate. But let’s think about it:
* OpenAI has dominated the consumer AI market with their **ChatGPT** and other tools.
* They’ve been losing ground in the developer market, where models like [Gemini](https://deepmind.google/models/gemini/pro/) and particularly [Claude (Anthropic)](https://claude.ai/) are gaining traction in the proprietary space.
* Now they’re releasing open-source models that promise to compete at GPT-4 levels to try and bring in the Deepseek and Qwen crowd.
The timing feels a bit too convenient. OpenAI is essentially saying: “We get it. You want local, affordable, and flexible AI? We’ve got you covered.” But will this be enough to win back the developer community? Or are they just delaying the inevitable?
## The Real Power of Local Models
Let’s not sugarcoat it: For developers, the real value of AI isn’t in chatbots or viral social media trends. It’s in building tools that can automate, analyze, and enhance existing workflows. Think:
* Summarizing thousands of documents in seconds.
* Automating customer support with natural language processing.
* Creating dynamic content for apps and websites on the fly.
This is where AI shines—and where OpenAI has been losing market and mind share. Their focus on consumer-facing tools like ChatGPT has made them a household name, but it’s also left developers feeling overlooked. Now, with GPT-OSS, OpenAI is trying to bridge that gap. But will they succeed? Or are they just too late to the party?
## The Dark Side of Monocultures
One thing I’m deeply concerned about is the potential for a monoculture in AI. If OpenAI manages to dominate the open-source space with GPT-OSS, we could end up in a world where everyone uses variations of the same model. It’s not just about vendor lock-in—it’s about stifling innovation. When every developer uses the same tools and approaches, we lose the diversity that drives progress.
I want to see a future where there are **multiple open-source or at the very least open weight models**, each with their own strengths and weaknesses. That way, developers can choose what works best for their needs instead of being forced into one ecosystem.
## Testing the Waters: My Journey With GPT-OSS
This blog post was partly written by GPT-oss-20b. It’s fast, it’s local, and it’s surprisingly good at generating content. But is it better than open weight alternatives like Deepseek or Gemma (the open weight gemini)? That’s the million-dollar question.
I’ve been testing out various models for my own projects, and I can say this much: GPT-OSS feels like a solid contender. It’s fast, easy to integrate, and—dare I say it—fun to work with. But until I put it head-to-head with other models, I won’t be ready to crown it the king of AI.
## Final Thoughts: The Future of AI is in Our Hands
The release of GPT-OSS is a big deal—not just for OpenAI, but for the entire AI community. It’s a reminder that even closed-source giants can (and should) listen to their users. But let’s not get carried away. OpenAI isn’t the only game in town anymore. Models like Gemini, Claude in the proprietary space, and Qwen and Llama in open source space are proving that diversity is key to innovation.
As developers, we have the power to choose which models succeed—and by extension, shape the future of AI. Let’s make sure we’re making choices that benefit the community as a whole, not just a single company. After all, the last thing we need is another **AI monoculture**.
@@ -1,4 +1,4 @@
Title: Intergrating Ollama and Matrix with Baibot
Title: Integrating Ollama and Matrix with Baibot
Date: 2025-06-25 20:00
Modified: 2025-06-30 08:00
Category: AI, Data, Matrix
@@ -0,0 +1,93 @@
Title: MCP and Ollama - Local Assistant is getting nearer
Date: 2025-07-24 20:00
Modified: 2025-07-24 20:00
Category: AI
Tags: tech, ai, ollama, mcp, ai-tools
Slug: mcp-ollama-local-assistant-soon
Authors: Andrew Ridgway
Summary: An Exploration of the Model Context Protocol and its potential to revolutionise how we interact with AI
## Human Introduction
So for today's blog I've upped the model paramters on both the editors and a couple drafters.. and I have to say I think we've nailed what my meagre hardware can achieve in terms of content production. The process take 30 more minutes than before to churn now but that quality output more than makes up for it. For context we are now using:
- _Editor_: Gemma3:27b
- _Journalist 1_: phi4-mini:latest
- _Journalist 2_: phi4:latest
- _Journalist 3_: deepseek-r1:14b <-> _I know but it **is** good even if it won't talk about Tiananmen Square_
- _Journalist 4_: qwen3:14b
As you can see if you compare some of the other blogs this blog has really nailed tone and flow. Some of the content was wrong.. it thought I "wrote" [MCPO](https://github.com/open-webui/mcpo), I didn't, I wrapped it, and the sign off was very cringe but otherwise the blog is largely what came out from the editor.
As I get better hardware and can run better models, I fully see this being something that could potentially not need much editing on this side.. have to see how it goes moving forward... anyways, without futher adieu, Behold.. MCP and Ollama - A blog _**about**_ AI _**by**_ AI
## Introduction: Beyond the Buzzwords – A Real Shift in AI
For the last couple of weeks, I’ve been diving deep into **MCP** – both for work and personal projects. It’s that weird intersection where hobbies and professional life collide. Honestly, I was starting to think the whole AI hype was just that – hype. But MCP? It’s different. It’s not just another buzzword; it feels like a genuine shift in how we interact with AI. It’s like finally getting a decent internet connection after years of dial-up.
The core of this change is the **Model Context Protocol** itself. It’s an open specification, spearheaded by **Anthropic**, but rapidly gaining traction across the industry. Google’s thrown its weight behind it with [MCP Tools](https://google.github.io/adk-tools/mcp-tools/), and Amazon’s building it into [Bedrock Agent Core](https://aws.amazon.com/bedrock/agent-core/). Even Apple, with its usual air of exclusivity, is likely eyeing this space.
## What *Is* MCP, Anyway? Demystifying the Protocol
Okay, let’s break it down. **MCP** is essentially a standardized way for **Large Language Models (LLMs)** to interact with **tools**. Think of it as giving your AI a set of keys to your digital kingdom. Instead of just *talking* about doing things, it can actually *do* them.
Traditionally, getting an LLM to control your smart home, access your code repository, or even just send an email required a ton of custom coding and API wrangling. MCP simplifies this process by providing a common language and framework. It’s like switching from a bunch of incompatible power adapters to a universal charger.
The beauty of MCP is its **openness**. It’s not controlled by a single company, which fosters innovation and collaboration. It’s a bit like the early days of the internet – a wild west of possibilities.
## My MCP Playground: Building a Gateway with mcpo
I wanted to get my hands dirty, so I built a little project wrapping [**mcpo**](https://github.com/open-webui/mcpo) in a container that can pull in config to create a containerised service. It’s a gateway that connects **OpenWebUI** – a fantastic tool for running LLMs locally – with various **MCP servers**.
The goal? To create a flexible and extensible platform for experimenting with different AI agent tools within my build pipeline. I wanted to be able to quickly swap out different models, connect to different services, and see what happens. It’s a bit like having a LEGO set for AI – you can build whatever you want.
You can check out the project [here](https://git.aridgwayweb.com/armistace/mcpo_mcp_servers). If you’re feeling adventurous, I encourage you to clone it and play around. I’ve got it running in my **k3s cluster** (a lightweight Kubernetes distribution), but you can easily adapt it to Docker or other containerization platforms.
## Connecting the Dots: Home Assistant and Gitea Integration
Right now my wrapper supports two key services: **Home Assistant** and **Gitea**.
**Home Assistant** is my smart home hub – it controls everything from the lights and thermostat to the security system. Integrating it with mcpo allows me to control these devices using natural language commands. Imagine saying, “Hey AI, dim the lights and play some jazz,” and it just happens. It’s like living in a sci-fi movie.
**Gitea** is my self-hosted Git service – it’s where I store all my code. Integrating it with mcpo allows me to use natural language to manage my repositories, create pull requests, and even automate code reviews. It’s like having a personal coding assistant.
I initially built a custom **Gitea MCP server** to get familiar with the protocol. But the official **Gitea-MCP** project ([here](https://gitea.com/gitea/gitea-mcp)) is much more robust and feature-rich. It’s always best to leverage existing tools when possible.f
Bringing in new MCP servers should be as simple as updating the config to provide a new endpoint and, if using stdio, updating the build script to bring in the mcp binary or git repo with the mcp implementation you want to use.
## The Low-Parameter Model Challenge: Balancing Power and Efficiency
I’m currently experimenting with **low-parameter models** like **Qwen3:4B** and **DeepSeek-R1:14B**. These models are relatively small and efficient, which makes them ideal for running on local hardware. However, they also have limitations.
One of the biggest challenges is getting these models to understand complex instructions. They require very precise and detailed prompts. It’s like explaining something to a child – you have to break it down into simple steps.
Another challenge is managing the context window. These models have a limited memory, so they can only remember a certain amount of information. This can make it difficult to have long and complex conversations.
## The Future of AI Agents: Prompt Engineering and Context Management
I believe the future of AI lies in the development of intelligent **agents** that can seamlessly interact with the world around us. These agents will need to be able to understand natural language, manage complex tasks, and adapt to changing circumstances.
**Prompt engineering** will be a critical skill for building these agents. We’ll need to learn how to craft prompts that elicit the desired behavior from the models. Almost like coding in a way but with far less structure and no need to understand the "syntax". But we're a long way from here yet
**Context management** will also be crucial. We’ll need to develop techniques for storing and retrieving relevant information, so the models can make informed decisions.
## Papering Over the Cracks: Using MCP to Integrate Legacy Systems
At my workplace, we’re exploring how to use MCP to integrate legacy systems. Many organizations have a patchwork of different applications and databases that don’t easily communicate with each other.
MCP can act as a bridge between these systems, allowing them to share data and functionality. It’s like building a universal translator for your IT infrastructure.
This can significantly reduce the cost and complexity of integrating new applications and services, if we get the boilerplate right.
## Conclusion: The Dawn of a New Era in AI
MCP is not a silver bullet, but it’s a significant step forward in the evolution of AI. It provides a standardized and flexible framework for building intelligent agents that can seamlessly interact with the world around us.
I’m excited to see what the future holds for this technology. I believe it has the potential to transform the way we live and work.
If you’re interested in learning more about MCP, I encourage you to check out the official website ([https://modelcontextprotocol.io/introduction](https://modelcontextprotocol.io/introduction)) and explore the various projects and resources that are available.
And if you’re feeling adventurous, I encourage you to clone my mcpo project ([https://git.aridgwayweb.com/armistace/mcpo_mcp_servers](https://git.aridgwayweb.com/armistace/mcpo_mcp_servers)) and start building your own AI agents.
It's been a bit of a ride. Hopefully I'll get a few more projects that can utilise some of these services but with so much new stuff happening my 'ooo squirell' mentality could prove a bit of a headache... might be time to crack open the blog_creator and use crew ai and mcp to create some research assistants on top of the drafters and editor!
Talk soon!