
Running LLMs locally with Ollama
A step-by-step guide to installing Ollama on macOS and running large language models like llama2 and Mistral entirely offline. Learn how to interact with the models via chat, API, and even remotely using ngrok.
All my posts about AI
12 posts

A step-by-step guide to installing Ollama on macOS and running large language models like llama2 and Mistral entirely offline. Learn how to interact with the models via chat, API, and even remotely using ngrok.

I had some time so decided to have a play with a new tool called Aider Chat, which allows you to write and edit code with OpenAIβs GPT models.