To fix the way we test and measure models, AI is learning tricks from social science. It’s not easy being one of Silicon Valley’s favorite benchmarks. SWE-Bench (pronounced “swee bench”) launched in ...

Artificial intelligence is now more pervasive than ever in the apps and gadgets we use day to day, and that of course extends to smartphones: Google Gemini on Pixels and other Android handsets, Apple ...

The new benchmark, called Elephant, makes it easier to spot when AI models are being overly sycophantic—but there’s no current fix. Back in April, OpenAI announced it was rolling back an update to its ...

Artificial intelligence systems may be good at generating text, recognizing images, and even solving basic math problems—but when it comes to advanced mathematical reasoning, they are hitting a wall.