Developer Tools

Kagi Small Web

New search engine crawls independent sites, offering a privacy-focused alternative to Google.

Deep Dive

Kagi, the company behind the subscription-based search engine, has launched a new product called 'Small Web.' This is a dedicated search index designed to surface content from a specific slice of the internet: independent, personal, and non-commercial websites, blogs, and forums. The index currently contains over 100 million pages and is built using Kagi's own crawler, which is programmed to avoid AI-generated and spammy content, focusing instead on what it deems authentically human-created.

Unlike Kagi's primary 'Universal Search'—which aggregates results from its own index and major providers like Google and Bing—Small Web operates as a separate, curated experience. Users can toggle between the two. The goal is to create a search environment free from the influence of large platforms and SEO-driven commercial sites, reviving the feel of the early, decentralized web. This move positions Kagi not just as a Google alternative, but as a tool for rediscovering the long tail of personal publishing.

The launch is part of Kagi's broader mission to build a more diverse and user-respecting search ecosystem. By offering a paid service, Kagi aligns its incentives with user privacy and quality, rather than advertising. Small Web represents a bet that there is demand for tools that help people navigate the internet beyond the homogenized results of dominant search engines, catering to researchers, hobbyists, and anyone nostalgic for the web's indie roots.

Key Points
  • Indexes over 100 million pages from independent, non-commercial websites and blogs.
  • Uses a custom crawler designed to filter out AI-generated and spam content.
  • Operates as a separate search mode from Kagi's main Universal Search, offering a curated, ad-free experience.

Why It Matters

Offers professionals and researchers a clean, focused tool to discover authentic, human-created content away from SEO noise.