Research & Papers

TwinBI: Agentic digital twin boosts BI dashboard accuracy by 20%

New framework syncs LLM chats with dashboard state, slashing timeouts by 30%.

Deep Dive

Business intelligence (BI) dashboards increasingly integrate LLM-based assistants, but switching between direct manipulation and natural-language queries often breaks analytical consistency. Enter TwinBI, a framework from researchers Jisoo Jang and Wen-Syan Li that creates an 'agentic digital twin' — a shared analytical state that couples an LLM agent with the live dashboard. This allows users to filter, drill-down, and ask questions without losing context, as the system reconstructs state from a unified interaction log. TwinBI exposes artifacts like schema views, SQL queries, and an /insights command for state-grounded summaries.

In controlled A/B testing with the same backbone agent, TwinBI improved exact-match accuracy from 43.3% to 63.3% and partial-credit accuracy from 48.3% to 70.8%. Timeout rates plummeted from 40% to 10%, showing far more reliable multi-step analysis. A usability study confirmed high task accuracy and favorable ratings for the state-aware interaction. The dataset and source code are publicly available on arXiv. TwinBI points to a future where BI tools maintain coherent analytical narratives across both manual and conversational interactions.

Key Points
  • Exact-match accuracy improved from 43.3% to 63.3% in A/B benchmark
  • Timeout rate reduced from 40% to 10% with TwinBI
  • Exposes schema views, SQL, logs, and an /insights command for grounded summaries

Why It Matters

TwinBI bridges the gap between manual dashboard use and LLM chat, enabling seamless, state-aware BI analysis.

📬 Get the top 10 AI stories daily