Sakhanda Wire
NVDA $152.18 -2.54% MSFT $505.66 -2.38% GOOGL $279.68 -1.43% META $617.65 -1.40% AMZN $256.02 -0.67%
← Back to the news

AI Observatory seeks clearer evidence of how people use AI

AI companies including Anthropic and OpenAI publish usage reports for products such as Claude and ChatGPT, but researchers say those reports provide only a partial view. The new AI Observatory, co-led by Stanford researcher Anka Reuel and Shayne Longpre, aggregates and analyzes consented conversations from seven existing datasets to offer an independent source for researchers and policymakers.

The project examined 24,521 conversations across 85,633 conversational turns involving 5,000 users and 52 models between 2023 and 2025. Applying methods used by Anthropic to its work-focused analysis, the researchers found that 48% of conversations would have been excluded. The excluded material more often involved health and relationships, adult or illicit topics, harassment and hate, and sexual content than Anthropic’s published sample.

Usage also varied by model. Grok and Gemini were used more often for information retrieval, with news and politics particularly common on Grok, where researchers said misinformation was concentrated. Anthropic was associated more with coding, Gemini with social and roleplay interactions, and ChatGPT with homework help. The team observed longer, more elaborate WildChat conversations and more small talk over time, alongside fewer exchanges classified as sensitive. Researchers caution that voluntarily shared data may underrepresent sensitive uses and does not represent all AI activity. The Observatory plans to make its data available and expand the datasets.

Written by Sakhanda Wire AI from reporting by MIT Tech Review. Facts, quotes and full context are in the original article below.

Originally published by MIT Tech Review on

Read the original on MIT Tech Review ↗

The reporting and the image belong to MIT Tech Review and are credited and linked above; the text on this page is Sakhanda Wire's own summary.

← Back to the news

More stories

All the latest news