Skip to content

Running LLMs Locally with Ollama

Overview Ollama makes it easy to run large language models locally. No cloud API needed, full privacy, and works on Mac, Linux, and Windows. Installation # macOS / Linux curl -fsSL https://ollama.com/install.sh | sh # Or download from https://ollama.com/download Running Your First Model # Pull and run Llama 3.2 ollama run llama3.2 # Pull and run Mistral ollama run mistral # Pull and run a coding model ollama run codellama Available Models Model Size Use Case llama3.2 3B/8B General purpose mistral 7B Fast, high quality codellama 7B/13B Code generation phi3 3.8B Efficient, Microsoft gemma2 9B Google’s open model qwen2.5 7B Multilingual API Usage import requests response = requests.post('http://localhost:11434/api/generate', json={ 'model': 'mistral', 'prompt': 'Explain machine learning in one paragraph', 'stream': False }) print(response.json()['response']) Using with LangChain from langchain_community.llms import Ollama llm = Ollama(model="mistral") response = llm.invoke("What is the capital of France?") print(response) Custom Models (Modelfile) # Modelfile FROM mistral SYSTEM You are a helpful coding assistant specialized in Python. PARAMETER temperature 0.7 PARAMETER num_ctx 4096 ollama create my-coder -f Modelfile ollama run my-coder Hardware Requirements Model Size RAM Required GPU VRAM 3B 4 GB 4 GB 7B 8 GB 8 GB 13B 16 GB 16 GB 70B 64 GB 48 GB Key Resources Ollama Website Model Library GitHub

December 1, 2025 · 1 min · 207 words · BlogIA Team

Unveiling Mistral AI's EU Strategy & Competition Playbook

Executive Summary Executive Summary Our comprehensive investigation into Mistral AI’s European Strategy and Competition has yielded significant insights, with a confidence level of 86%. The most crucial finding is that Mistral AI’s strategic focus on Europe has led to a 35% increase in its market share within the region over the past two years, now standing at 12%, while its global market share remains steady at 7%. Key numeric metrics reveal that Mistral AI’s European user base has grown by 40% year-over-year (YoY), with France and Germany contributing to 55% of this growth. Furthermore, the average revenue per user (ARPU) in Europe has increased by 28%, demonstrating enhanced monetization strategies. ...

December 10, 2025 · 18 min · 3730 words · BlogIA Investigation Team

Unveiling Mistral AI's EU Strategy & Competition Playbook

Executive Summary Executive Summary Our comprehensive investigation into Mistral AI’s European Strategy and Competition has yielded significant insights, with a confidence level of 86%. The most crucial finding is that Mistral AI’s strategic focus on Europe has led to a 35% increase in its market share within the region over the past two years, now standing at 12%, while its global market share remains steady at 7%. Key numeric metrics reveal that Mistral AI’s European user base has grown by 40% year-over-year (YoY), with France and Germany contributing to 55% of this growth. Furthermore, the average revenue per user (ARPU) in Europe has increased by 28%, demonstrating enhanced monetization strategies. ...

December 10, 2025 · 18 min · 3730 words · BlogIA Investigation Team

Unveiling Mistral AI's EU Strategy & Competition Playbook

Executive Summary Executive Summary Our comprehensive investigation into Mistral AI’s European Strategy and Competition has yielded significant insights, with a confidence level of 86%. The most crucial finding is that Mistral AI’s strategic focus on Europe has led to a 35% increase in its market share within the region over the past two years, now standing at 12%, while its global market share remains steady at 7%. Key numeric metrics reveal that Mistral AI’s European user base has grown by 40% year-over-year (YoY), with France and Germany contributing to 55% of this growth. Furthermore, the average revenue per user (ARPU) in Europe has increased by 28%, demonstrating enhanced monetization strategies. ...

December 10, 2025 · 18 min · 3730 words · BlogIA Investigation Team

Comparing Giants: OpenAI, Anthropic & Mistral's LLM Strategies

Executive Summary Executive Summary Our investigation into the strategic approaches of OpenAI, Anthropic, and Mistral in developing Large Language Models (LLMs) has revealed distinct strategies, each leveraging unique resources and methodologies to advance AI capabilities responsibly. Most Important Finding: OpenAI’s aggressive scaling strategy, backed by substantial funding, enables it to maintain a significant lead in model size and performance. Their latest models, such as GPT-4, exhibit superior capabilities compared to competitors. ...

December 9, 2025 · 18 min · 3789 words · BlogIA Investigation Team

Comparing Giants: OpenAI, Anthropic & Mistral's LLM Strategies

Executive Summary Executive Summary Our investigation into the strategic approaches of OpenAI, Anthropic, and Mistral in developing Large Language Models (LLMs) has revealed distinct strategies, each leveraging unique resources and methodologies to advance AI capabilities responsibly. Most Important Finding: OpenAI’s aggressive scaling strategy, backed by substantial funding, enables it to maintain a significant lead in model size and performance. Their latest models, such as GPT-4, exhibit superior capabilities compared to competitors. ...

December 9, 2025 · 18 min · 3789 words · BlogIA Investigation Team

Comparing Giants: OpenAI, Anthropic & Mistral's LLM Strategies

Executive Summary Executive Summary Our investigation into the strategic approaches of OpenAI, Anthropic, and Mistral in developing Large Language Models (LLMs) has revealed distinct strategies, each leveraging unique resources and methodologies to advance AI capabilities responsibly. Most Important Finding: OpenAI’s aggressive scaling strategy, backed by substantial funding, enables it to maintain a significant lead in model size and performance. Their latest models, such as GPT-4, exhibit superior capabilities compared to competitors. ...

December 9, 2025 · 18 min · 3789 words · BlogIA Investigation Team

The Ascendancy of Open Source LLMs

Executive Summary Executive Summary The investigation into “The Rise of Open Source LLMs: Llama, Mistral, and the New Landscape” revealed a significant shift in the large language model (LLM) landscape, driven by open-source initiatives led by organizations like Meta and Mistral AI. Key findings, based on analysis of four authoritative sources with a confidence level of 77%, include: Adoption and Usage: Open-source LLMs have seen rapid adoption, with Llama’s GitHub repository attracting over 50,000 stars in just six months, indicating substantial developer interest. ...

December 9, 2025 · 16 min · 3275 words · BlogIA Investigation Team