AI can now spot when you've built your IKEA furniture wrong. Epoch AI's Furniture Assembly Benchmark (FAB) photographs three IKEA pieces during assembly with deliberate errors. Models compare photos against instructions, identify mistakes, and describe what went wrong. In November 2025, the best model (Claude Opus 4.5) scored 28%. Ten months later, OpenAI's GPT-6 Astra hits 80% at three minutes per photo. Claude Fable 5.1 follows at 70%, Claude Opus 5 at 61%. Chinese open-weight models like Kimi K3 trail leaders by at least seven months.
OpenAI's GPT-6 Astra spots assembly errors in IKEA furniture photos with 80 percent accuracy, up from 28 percent just months ago. | Image: OpenAI
It's still too slow for real-time assembly help, but the tech could eventually assist with car repairs or appliance fixes, the researchers say. The overall progress, and especially Astra's, is notable given that models were failing far simpler visual tasks not long ago. Astra also excels at visual robotic tasks.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
