ZDNet

With AI models clobbering every benchmark, it's time for human evaluation

Artificial intelligence has traditionally advanced through automatic accuracy tests in tasks meant to approximate human knowledge. Carefully crafted benchmark tests such as The General Language ...
Time

AI Models Are Getting Smarter. New Tests Are Racing to Catch Up

Follow this section to personalize your feed and get instant alerts. WHY FOLLOW? Update your preferences in Account Settings Personalized Content Follow this tag to personalize your feed and get ...
UPI

AI model achieves human level performance on general intelligence test

Dec. 24 (UPI) --A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure "general intelligence". On December 20, OpenAI's o3 system scored 85% on ...
Android Police

OpenAI's simulated reasoning AI models matched human levels on ARC-AGI benchmark — Here's what that means for you

Benjamin is a business consultant, coach, designer, musician, artist, and writer, living in the remote mountains of Vermont. He has 20+ years experience in tech, an educational background in the arts, ...
The Conversation

An AI system has reached human level on a test for ‘general intelligence’. Here’s what that means

A new artificial intelligence (AI) model has just achieved human-level results on a test designed to measure “general intelligence”. On December 20, OpenAI’s o3 system scored 85% on the ARC-AGI ...
MIT Technology Review

AI benchmarks are broken. Here’s what we need instead.

One-off tests don’t measure AI’s true impact. We’re better off shifting to more human-centered, context-specific methods. For decades, artificial intelligence has been evaluated through the question ...
The New York Times

Are You Smarter Than A.I.?

Some experts predict that A.I. will surpass human intelligence within the next few years. Play this puzzle to see how far the machines have to go. By Dylan Freedman and Cade Metz Produced by Juliana ...