New AI Trick Makes Chatbots 100x Faster and Cheaper
This could save businesses thousands and make AI respond instantly.
Businesses often use AI chatbots to handle repetitive tasks, like processing orders or answering customer questions. These chatbots follow a set of instructions, but they rely on the AI to make decisions at every step, which is slow and expensive. Now, researchers have developed a method called ReTrace that turns these instructions into a fixed workflow, where code handles the steps instead of the AI. This makes the process much faster and cheaper.
In tests, ReTrace completed 93.8% of tasks correctly, compared to 96.8% for the AI agent, but at 24% lower cost. On a standard benchmark, it finished tasks in 1.3 seconds instead of 170 seconds—more than 100 times faster. After some fine-tuning, success rates improved to 81.2%. This means businesses could save money and time while still getting good results.
The catch is that ReTrace requires a few example runs to learn from, and it might not handle every edge case as well as a full AI. But for repetitive tasks, it's a big win. This could lead to cheaper, faster automated services for everyone, from online shopping to banking.
- ReTrace converts AI-driven workflows into code-based ones, cutting costs by 24% and speeding up tasks by over 100x.
- It achieves near-AI accuracy (93.8% vs. 96.8%) on real business procedures.
- After repair, success rates improve to 81.2%, making it a viable option for many repetitive tasks.
Why It Matters
Businesses can save money and time on automated tasks, leading to cheaper and faster services for consumers.