LM Studio: Run Local LLMs & API Server (2026)
🚀 Quick start
- Download and install LM Studio from the official site.
- Use the built-in model browser to download a small quantized model (e.g., Qwen2.5-1.5B-Instruct-Q4_K_M.gguf).
- Load the model in the Chat tab, then switch to the Server tab and start the server on port 1234.
- Point any OpenAI-compatible client at http://localhost:1234/v1 and use the exact model name shown in the Server tab.
💡 Why use LM Studio for this
LM Studio is a free desktop app that lets you download, run, and serve large language models locally on your own machine. It bundles a model browser, a chat interface, and an OpenAI-compatible API server, so you can point existing tools and scripts at http://localhost:1234/v1 without writing any code. The app is free for personal and commercial use; there is no paid tier as of October 2026. This guide walks through the practical workflow: install, download a small quantized model, load it, and start the server. [TODO: our test] verify exact button labels and menu names against the current LM Studio release, as the UI changes frequently.
🛠️ How to Run Local LLMs & API Server (4 steps)
Step 1
Go to lmstudio.ai and download the installer for your operating system (macOS or Windows). Run the installer and follow the default prompts.
Step 2
Open LM Studio. In the left sidebar, click the model browser icon (magnifying glass or cube). In the search bar, type "Qwen2.5-1.5B-Instruct-Q4_K_M.gguf" and click the download button next to the file. Wait for the download to complete.
Step 3
Switch to the Chat tab (left sidebar, chat bubble icon). At the top, click the model dropdown and select the downloaded model (e.g., Qwen 2.5 1.5B Instruct). Wait for loading to finish — you should see the model name appear with a green indicator.
Step 4
Click the Server tab (left sidebar, plug/server icon). From the model dropdown, select the same model you loaded. Leave the port at 1234. Optionally set the context length (recommended minimum 4096). Click the Start Server button. The status should change to "Running".
📦 What you'll get
After starting the server, you get a local API endpoint at http://localhost:1234/v1 that accepts OpenAI chat completions requests. You can test it with curl or any OpenAI SDK by setting the base URL to http://localhost:1234/v1 and using the exact model name shown in the Server tab (e.g., "qwen2.5-1.5b-instruct-q4_k_m").
💰 Pricing (checked 2026-10-15)
📋 Copy-paste prompts
"Summarize the following transcript into 3–5 bullet points covering key decisions and action items: [paste transcript]"
"Explain this code snippet step by step, then suggest one performance optimization: [paste code]"
"Extract all email addresses, phone numbers, and dates from this text. Return them as a JSON object: [paste text]"
⚠️ Common mistakes
⚖️ LM Studio vs Alternatives
| Tool | Price | Best For | Verdict |
|---|---|---|---|
Free (open source) |
|||
Free (open source) |
❓ Frequently Asked Questions
Q: Is LM Studio really free?
Yes. As of October 2026, LM Studio is free for personal and commercial use with no paid tiers. You can download and use it without an account.
Q: What are the minimum system requirements for LM Studio?
You need a computer with at least 8 GB of RAM (16 GB recommended for 7B-class models), and either macOS or Windows. A GPU is optional but speeds up inference.
Q: Can I use LM Studio with the OpenAI Python SDK?
Yes. Set the base URL to http://localhost:1234/v1 and use the exact model name shown in the Server tab. The API is compatible with OpenAI's chat completions format.
Q: How do I find the correct model name for API calls?
In the Server tab, the model dropdown shows the exact name to use. It often includes quantization info, e.g., "qwen2.5-1.5b-instruct-q4_k_m".
Q: Does LM Studio work offline?
Yes, once you have downloaded a model, you can run it entirely offline. The initial download requires an internet connection.
Q: Can I run multiple models at once?
LM Studio typically loads one model at a time in the Server tab. For concurrent multi-model serving, consider vLLM or Ollama.
🚀 Level up your AI toolkit
Understand AI in 5 minutes a day. No jargon. No hype. Unsubscribe anytime.