New AI Method Helps Chatbots Pick the Right Skill Every Time
This could make AI assistants like Siri and Alexa much smarter.
Similar agent skills can share instructions but differ in their conditions of use. Query-based text selection may retain shared instructions and omit these distinctions.
We introduce SkillContrast, a training-free selector that compares retrieved skills and retains their differing text with local context for a pretrained reranker. On 1,235 requests from SameCapRisk-Bench, it yields 54-72 more clean hits (requests that retrieve a helpful skill without its marked risky sibling) than TF-IDF query selection at identical per-candidate input lengths, across 2 retrievers and 2 reranker sizes.
Length-matched component replacements identify differing text as the main contributor in the primary setting, with smaller, mixed context effects. Relative to full skill bodies, SkillContrast uses 51.1-58.8% fewer model-input tokens, with 10-18 fewer clean hits at 0.6B and matching or higher observed clean-hit counts at 4B. Candidate-relative differences thus complement query relevance in selecting compact reranking inputs.
- SkillContrast is a new method that helps AI assistants choose the right skill by comparing differences between them.
- It reduces errors when skills sound similar, like confusing a taxi with a flight booking.
- This could lead to more reliable voice assistants that understand you better and require less repetition.
Why It Matters
Smarter AI assistants mean less frustration and more time saved on everyday tasks.