A couple of experiments today: I completed a simple tutorial that helps you build a RAG app using local models. I also installed and tested https://openwebui.com/. This is a really cool open source project that gives you a ChatGPT-style interface to use with large language models that run locally and offline on your machine. You can see an example of it below.
Running LLMs locally doesn’t generate the same performance as the big cloud-based models. However, if you’re travelling and don’t have internet access, it’s a great hack!
