Compare commits
20
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
a78771439f | ||
|
|
b38ca9f1e0 | ||
|
|
814aab900c | ||
|
|
da1bfd4779 | ||
|
|
49167ee308 | ||
|
|
b9210910f5 | ||
|
|
040d90ce73 | ||
|
|
70c1dfdbb2 | ||
|
|
f5b370e048 | ||
|
|
678d7f4308 | ||
|
|
f3582e5881 | ||
|
|
74fb66d81e | ||
|
|
874df3c8c3 | ||
|
|
2280630149 | ||
|
|
9b440b775a | ||
|
|
1de70f3e48 | ||
|
|
8f50570084 | ||
|
|
57502673de | ||
|
|
aeb05e6df4 | ||
|
|
28595ead23 |
@@ -1,5 +1,8 @@
|
||||
name: Build and Push Image
|
||||
on: [ push ]
|
||||
on:
|
||||
push:
|
||||
branches:
|
||||
- master
|
||||
|
||||
jobs:
|
||||
build:
|
||||
|
||||
@@ -12,11 +12,11 @@ As mentioned in the last post I have been experimenting with AI content generati
|
||||
|
||||
It's still not in the state I want it to be and isn't connecting to the actual blog repo yet (the idea being that I edit and change as part of a review process). But it is generating stuff that I thought would be worth a share just for fun. The eventual idea is the container will be something I trigger as part of a CI/CD process when the equipment is up and running but the final "production" implementation is still being fleshed out in my head (if you can call a homelab project "production")
|
||||
|
||||
The focus to this point has been on prompt engineering and model selection. A big part of this is that it needs to be able to run completely indepdantly of any cloud services so no Chat GPT.
|
||||
The focus to this point has been on prompt engineering and model selection. A big part of this is that it needs to be able to run completely independently of any cloud services so no Chat GPT.
|
||||
|
||||
The obvious solution is [ollama](https://ollama.com) I'm luck enough to have a modest secondary gaming rig in my living room with an nvidia 2060 in it that can act as a modest AI server so I have set it up there.
|
||||
The obvious solution is [ollama](https://ollama.com) I'm lucky enough to have a modest secondary gaming rig in my living room with an nvidia 2060 in it that can act as a modest AI server so I have set it up there.
|
||||
|
||||
This server has allowed me to experiment almost at will with models. a few I tried included
|
||||
This server has allowed me to experiment, almost at will, with models. a few I tried included
|
||||
|
||||
- llama3.2
|
||||
- zephyr
|
||||
@@ -29,6 +29,7 @@ However I have found that mistral-nemo seems to be the strongest contender, at l
|
||||
You can see the code and what I have been working on for more details [HERE](https://git.aridgwayweb.com/armistace/blog_creator)
|
||||
|
||||
#### The summary prompt used by mistral to generate this post
|
||||
|
||||
_The following is what I have in trilium to generate the AI written content_
|
||||
|
||||
Get a python file that can communicate with a local ollama instance
|
||||
@@ -50,7 +51,8 @@ Send a notification to matrix that there is a new PR in and give a summary of th
|
||||
_as you can see it pretty light on content so what it generates given this lack of context I feel is pretty good_
|
||||
|
||||
# Let the post begin (begin...begin...begin...)
|
||||
_What follows is what it generated.. yes it is hilarious but well... it was to good not to share_
|
||||
|
||||
_What follows is what it generated.. yes it is hilarious but well... it was too good not to share_
|
||||
|
||||
# G'day, mates! Let's make an Ollama Blog Writer!
|
||||
|
||||
|
||||
@@ -0,0 +1,63 @@
|
||||
Okay, this is a great start! You've captured the requested tone and structure very well. Here's a refined version, incorporating your feedback and aiming for even more polish and engagement. I'm focusing on tightening the language, adding more specific examples, and enhancing the overall flow. I've also added a few more "Australianisms" to really lean into the theme.
|
||||
|
||||
```markdown
|
||||
## Testing Matrix Notifications: A Fair Dinkum Adventure!
|
||||
|
||||
G'day, tech enthusiasts! Grab your favourite cuppa (or a coldie!) and settle in, because I'm about to take you on an Australian-themed adventure through matrix notifications. Trust me, it’s less like James Bond escaping from danger (though that sounds pretty bonza) and more of a light-hearted romp into the world of software development with a few cheeky jokes thrown in for good measure.
|
||||
|
||||
## The Plot Thickens: Matrix Notifications Enabled
|
||||
|
||||
It all started when I decided to enable those pesky matrix notifications. Why? Because, well... curiosity got the better of me (and who can blame us?). Imagine waking up one morning and discovering you have a new way of getting notified about your GitHub updates or Telegram messages directly in your chat room! Sounds thrilling, eh? But here’s where it gets interesting: I decided to take advantage of my Australian cunning by leveraging n8n. Yep, that's right – I'm using this nifty little tool because its webhook model is a lot simpler than trying out other ways (I mean, who has the time?).
|
||||
|
||||
## A Clever Twist with Grafana and Matrix
|
||||
|
||||
Now that I've got matrix notifications rolling in smoothly thanks to our trusty friend n8n, I thought, "Why not extend this further?" So here’s where it gets even smarter: I'm also using this mechanism for Grafana alerting directly into my own Matrix instance. Picture this: you've been working tirelessly on a Python project involving some cutting-edge AI (let's call that Ollama), and suddenly your laptop decides to take an unscheduled break, thanks to overheating. But don't worry! Your Grafana alerts will let you know about the temperature rising in no time at all, pinging directly into your Matrix room. No more frantic searches for a thermometer!
|
||||
|
||||
**Example:** I had a server running a machine learning model for image recognition. Without Grafana alerts, I wouldn't have known it was running hot until it crashed. Now, I get a notification the moment the CPU hits 85°C – plenty of time to take action.
|
||||
|
||||
## The Tech Behind My Fair Dinkum Scheme
|
||||
|
||||
Let's dive a bit deeper now because who doesn’t love some techy goodness? Here's what I've been using:
|
||||
|
||||
* **Matrix:** This cool platform is like Discord on steroids (and it's open-source). You can send messages, have voice/video calls, and even get notifications. Seriously awesome stuff.
|
||||
* **n8n:** Think of this as your Swiss Army knife for automating workflows between different services without writing any code. It's a real time-saver.
|
||||
* **Python & Ollama:** Now we're getting into the nitty-gritty! Python is my go-to programming language, thanks to its simplicity and versatility. And then there's our AI buddy – Ollama (yes, it's real) that helps me with some heavy-lifting tasks like text generation or even summarizing articles.
|
||||
|
||||
**Example:** I use Python to write scripts that monitor my servers and send alerts to n8n. Then, n8n formats the alert and sends it to my Matrix room.
|
||||
|
||||
## A Little Homework for You
|
||||
|
||||
I want this blog post not just to entertain but also inspire you! So here’s what I’m going to do next:
|
||||
|
||||
1. **Generate a Summary:** I'll use AI (like my friend Ollama) again, and let it generate an engaging summary of our adventures so far.
|
||||
2. **Git Code Extension & Pull Request Magic:**
|
||||
* I'm considering extending the Git code directly within this blog post repository because why not? (A bit of a show pony move, I know!)
|
||||
* I will also create a pull request with all these changes (yes, even if it's just for fun).
|
||||
3. **Approval Button Dilemma:** Should there be an “approval” button in my Matrix instance that lets users approve or reject the bot-generated summary? Thoughts? (A bit ambitious, but who knows?)
|
||||
4. **Academic Undertakings:** I’m aware this blog post isn't entirely within our Git repo, but let’s not forget to mention it. (Gotta keep things honest!)
|
||||
5. **Tech Breakdown for You:** Let me know which parts of my tech stack you found most interesting or useful.
|
||||
|
||||
## Wrap-Up: Engage and Explore
|
||||
|
||||
I hope you've enjoyed wandering through the light-hearted world I've created with matrix notifications (and a sprinkle of AI). Remember, if you're ever curious about diving into this setup yourself – whether it's using n8n for your own automated workflows or integrating Grafana alerts straight to Matrix – there's plenty more where that came from. So go ahead and explore! And who knows? Maybe one day you'll be sending matrix notifications across the globe with just a few clever tweaks. Until then, keep coding (or should I say crafting?) in style! Cheers, [Your Name], Tech Enthusiast Extraordinaire!
|
||||
|
||||
**Glossary of Australianisms:**
|
||||
|
||||
* **G'day:** Hello
|
||||
* **Cuppa:** Cup of tea or coffee
|
||||
* **Coldie:** Cold beer
|
||||
* **Bonza:** Excellent, fantastic
|
||||
* **Fair Dinkum:** Genuine, true
|
||||
* **Show Pony:** Someone who likes to show off
|
||||
```
|
||||
|
||||
**Key Changes and Explanations:**
|
||||
|
||||
* **More Australianisms:** Added more phrases like "Fair Dinkum," "Show Pony," and a glossary at the end to really embrace the theme.
|
||||
* **Specific Examples:** Added a concrete example of the server monitoring scenario to make the benefits more tangible.
|
||||
* **Stronger Flow:** Reorganized sentences and paragraphs for better readability.
|
||||
* **More Engaging Language:** Used more descriptive and playful language throughout.
|
||||
* **Clarified Ambitions:** Acknowledged the "approval button" idea as ambitious to manage expectations.
|
||||
* **Glossary:** Included a glossary of Australianisms for those unfamiliar with the lingo.
|
||||
|
||||
This revised version should be even more engaging and informative while maintaining the requested tone and style. Let me know if you'd like any further refinements!
|
||||
@@ -0,0 +1,54 @@
|
||||
# Human Introduction
|
||||
Well.. today is the first day that the automated pipeline has generated content for the blog... still a bit of work to do including
|
||||
1. establishing a permanent vectordb solution (chromadb? pg_vector?)
|
||||
2. Notification to Matrix that something has happened
|
||||
3. Updating Trilium so that the note is marked as blog_written=true
|
||||
|
||||
BUT it can take a note from trilium, generate drafts with mulitple agents, and then use RAG to have an editor go over those drafts.
|
||||
|
||||
I'm particularly proud of the randomness I've applied to temperature, top_p and top_k for the different draft agents. This means that each pass is giving me quite different "creativity" (as much as that can be applied to an algorithm that is essentially munging letters together that have a high probability of being together) It has created some really interesting variation for the editor to work with and getting some really interesting results.
|
||||
|
||||
Anyways, without further ado, I present to you the first, pipeline written, AI content for this blog
|
||||
|
||||
---
|
||||
|
||||
# When to use AI 😄
|
||||
*A journalist, software developer, and DevOps expert’s take on when AI is overkill and when it’s just the right tool*
|
||||
|
||||
When I was building a spreadsheet called “shudders,” I was trying to figure out how to automate the process of mapping work types to work requests. The dataset was full of messy, unstructured text, and the goal was to find the best matches. At first, I thought, “This is a perfect use case for AI!” But then I realized: *this is the kind of problem where AI is basically a human’s worst nightmare*.
|
||||
|
||||
So, let’s break it down.
|
||||
|
||||
### 🧠 When AI is *not* the answer
|
||||
|
||||
AI is great at pattern recognition, but it’s not great at *understanding context*. For example, if I had a list of work types like “customer service,” “technical support,” or “maintenance,” and I needed to map them to work requests that had vague descriptions like “this task took 3 days,” AI would struggle. It’s like trying to find a needle in a haystack—*but the haystack is made of human language*.
|
||||
|
||||
The problem with AI in this scenario is that it’s *not good at interpreting ambiguity*. If the work types are vague, the AI might mislabel them, leading to errors. Plus, when the data is messy, AI can’t keep up. I remember one time I tried to use a chatbot to classify work requests. It was so confused, it thought “customer service” was a type of “technical support.” 😅 The result? A spreadsheet full of “unknown” entries.
|
||||
|
||||
### 🧮 When AI *is* the answer
|
||||
|
||||
There are some scenarios where AI is *definitely* the way to go. For example, when you need to automate repetitive tasks, like calculating workloads or generating reports. These tasks are math-heavy and don’t require creative thinking. Let’s say you have a list of work orders, each with a start time, end time, and duration. You want to calculate the average time per task. AI can do that with precision. It’s like a calculator, but with a personality.
|
||||
|
||||
Another example: if you need to generate a report that summarizes key metrics, AI can handle that. It’s not about creativity, it’s about logic. And that’s where traditional programming shines.
|
||||
|
||||
### 🧪 The balance between AI and human oversight
|
||||
|
||||
AI is a tool, not a replacement for human judgment. While it can handle the *analyzing* part, the *decisions* still need to be made by humans. For instance, if you’re trying to decide which work type to assign to a request, AI might suggest “customer service” based on keywords, but the final decision depends on context.
|
||||
|
||||
So, in the end, AI is a *helper*, not a *replacement*. It’s great for the parts that are repetitive, but the parts that require nuance, creativity, or deep understanding? That’s where humans step in.
|
||||
|
||||
### 🧩 Final thoughts
|
||||
|
||||
AI is like a superpower—great at certain things, not so great at others. It’s not a magic wand, but it’s a tool that can save time and reduce errors when used right.
|
||||
|
||||
So, when is it time to say “AI, nope”? When the data is messy, the tasks are ambiguous, or the results need to be human-approved. And when is it time to say “AI, yes”? When you need to automate calculations, generate reports, or handle repetitive tasks that don’t require creativity.
|
||||
|
||||
### 🧩 Summary
|
||||
|
||||
| Scenario | AI? | Reason |
|
||||
|---|---|---|
|
||||
| Ambiguous data | ❌ | AI struggles with context |
|
||||
| Repetitive tasks | ✅ | AI handles math and logic |
|
||||
| Creative decisions | ❌ | AI lacks the ability to think creatively |
|
||||
|
||||
In the end, AI is just another tool. Use it when it works, and don’t let it define your workflow. 😄 *And if you ever feel like AI is overstepping, remember: it’s just trying to be helpful. Sometimes it’s not the best choice. Sometimes it’s the only choice.*
|
||||
Reference in New Issue
Block a user