Puzzles reveal where AI models still struggle
Puzzles and games remain a useful way to examine the abilities and limits of artificial intelligence. In late 2024, researchers from Columbia University found that leading models solved only 18% of New York Times Connections puzzles. By early 2025, some models were solving the game almost perfectly. The progress illustrates how quickly performance can change, but failures still expose important weaknesses.