Haystack, the Free AI Search Engine Behind Office Chatbots, Just Got Faster

Haystack is a free building-block kit for developers who make "chat with your documents" tools — the kind of AI that reads your company's contracts, manuals or emails and answers questions about them. About 26,600 developers follow it, and it quietly powers search features inside plenty of workplace software. Version 3.3.0 shipped on October 1.

The biggest change is speed. One Haystack part — the piece that pulls the right passage out of your files — used to query the document database once for every file it fetched. Now it makes a single query per search. In plain terms: fewer trips to the filing cabinet, so answers arrive sooner and your company's servers do less sweating. The results themselves don't change, so existing setups get faster automatically.

There's also a real fix for non-English speakers. Chinese, Japanese and Korean are written without spaces between words, and Haystack used to chop those sentences up wrongly, meaning searches could silently fail. Now each character is handled properly, and text is cleaned up first so that two spellings of the same word behave identically. Separately, the update forces an upgrade to a common supporting library, anyio, to close a known security hole (CVE-2026-63374) that arrived through other software.

Smaller repairs matter too: Haystack was quietly deleting images and attached files from AI prompts without warning, and it was mangling Word document tables that contained links or vertical bars. A resource leak that left internet connections open after an AI assistant shut down is fixed as well.

The catch: this is a developer library, not an app you download. You won't install it — you'll just notice the tools you already use getting quicker, and staying secure, once their makers upgrade.