This is a little something that was getting started for work, but progress has stalled. It appears they are going to use a different implementation. (I am not giving away any work details here…)

Essentially, it is an AI based web page that utilizes a local LLM. The main idea was to upload information, and only answer questions using the uploaded data. The site would also have static pages if the user wanted to navigate it on their own.

The app is Flask based, using Ollama to connect to the LLM and the custom data is stored in a Faiss database. The database is scheduled to update every 24 hours, though an update can be triggered manually.

I called this article ‘Something From “Early” AI’, because this app began creation before Agentic AI was everywhere. I did use AI to help create items, but there was copying and pasting!

As I’ve said previously, AI is an amazing tool, but a tool that needs to be monitored. It is by no means perfect, and I am not certain it will ever get there… As I see it now, it’s impact is like home computing on steroids. Remember when you knew someone that had a computer, then almost every home had a computer, then everyone in the house had a computer, then everyone had multiple devices? Well, almost all those devices can run some sort of AI, and it’s reach is extending. I am curious and cautious to see where it goes from here.