Open Source

Cohere launches North Mini Code, an open-weight code model with 320K context

Free to try, deployable with vLLM, and optimized for code tasks.

Deep Dive

Cohere officially launched North Mini Code, a compact yet powerful code generation model with open weights. The model supports a 320K token context window and is available for download on Hugging Face in fp8 format. Developers can also try it for free on the OpenCode platform. For self-hosting, Cohere recommends using vLLM main branch (until a new release) with tensor parallelism (e.g., -tp 2) and installing the cohere_melody library for accurate response parsing. The model includes built-in tool-call and reasoning parsers, making it suitable for agentic code workflows.

Beyond deployment, North Mini Code has garnered early community support: a third-party MLX conversion enables efficient inference on Apple Silicon. Cohere acknowledges demand for quantization and llama.cpp support, signaling future updates. The launch reflects Cohere's commitment to developer-friendly, open models for code, with active feedback loops to refine capabilities. For teams building code assistants or automated development pipelines, this model offers a lightweight, long-context alternative to larger proprietary systems.

Key Points
  • Open weights available on Hugging Face (fp8 format) and free trial on OpenCode
  • Supports 320K token context window with vLLM deployment and tensor parallelism
  • Includes tool-call and reasoning parsers, plus MLX support for Apple Silicon

Why It Matters

An open-weight code model with long context and flexible deployment options accelerates AI-assisted development for professionals.

📬 Get the top 10 AI stories daily