A benchmark for measuring whether AI agents can deliver correct, verifiable, expert-level GPU kernel optimization.

Introducing KernelQuest: Can agents write Triton kernels?

The challenge: speed is easy to claim and hard to verify

Why we built KernelQuest

What KernelQuest measures

Quality is part of the benchmark, not a post-processing step

One task shows why the gates matter

Leaderboard

Failure modes

Building the evidence needed to push frontier models forward

Introducing CEO Bench: Evaluating frontier agents on real company work

The challenge: measuring judgment, not string matches

Introducing CEO Bench

From gold answers to graded judgment

Quality and methodology

Evaluation results

Failure-mode analysis

Next steps

Developed by Turing Frontier Research Lab, CyberStrike evaluates if agents can complete offensive, defensive, and incident response cybersecurity tasks.

Announcing CyberStrike: Measuring whether frontier agents can complete real cybersecurity work

Security work does not end at detection

The challenge: measuring completion, not partial progress

Introducing the CyberStrike benchmark

From plausible answers to verified outcomes

Task spotlight: when self-reported success does not survive replay

How CyberStrike advances the lab’s mission

Welcome to AGI Advance, Turing’s weekly recap of the most important AI & AGI developments...

3,600 trials on the 45 hardest tasks, and why an agent's own checks tell you almost nothing about whether it's right.

65% of Agent Failures Are Confident False Completions

What we're delivering

Explore Turing OTS Datasets

What we're celebrating

What we're reading

Where we’ll be

Stay ahead with AGI Advance

AGI Advance: Weekly AI & AGI Insights (Aug 18, 2026)

Offensive, defensive, and incident-response work, graded on real outcomes, not plausible answers.

CyberStrike: 200 Security Tasks Where Frontier Agents Still Break

AGI Advance: Weekly AI & AGI Insights (Sept 1, 2026)

Training general-purpose agents with real APIs, real users, and real privacy constraints.

35K+ Agent Trajectories and 120K+ RLHF Pairs Across 150+ Real Tools

AGI Advance: Weekly AI & AGI Insights (Aug 25, 2026)

Agents often solve the wrong problem, verify against their own misreading, and mark the task complete.

Terminal-Bench 3.0: Why capable agents fail confidently

Why self-verification fails

The data

Failure has moved upstream

The agent's own evidence is uninformative

Types of failure

Misreading the problem

Under-modeling the spec

Missing the numeric bar

Breaking under re-entry or concurrency

The traps persist across configurations

What independent verification requires

What we take from this

Five years of real enterprise history, 64 long-horizon tasks, and four failure patterns today's models still can't overcome.

GPT-5.5 Solves 44% of CompanyBench

AGI Advance: Weekly AI & AGI Insights (Aug 11, 2026)

Human-authored trajectories and anti-gaming verifiers for codebase reasoning.

1,000+ RL Tasks for Codebase Reasoning

AGI Advance: Weekly AI & AGI Insights (Aug 4, 2026)

Explore expert insights on AI at Turing’s blog. Learn how AI-powered solutions are driving innovation, model performance, and business growth.

Turing Blog: Articles, Insights, Company News and Updates

All blog posts

Partner with Turing to accelerate frontier research, deploy proprietary intelligence, or hire AI-native talent.

Train models, deploy intelligence, and hire talent with Turing.

Weekly updates on frontier benchmarks, evals, fine-tuning, and agentic workflows read by top labs and AI practitioners.

AGI Advance Newsletter

Talk to one of our solutions architects and start innovating with AI-powered talent.

Turing Blog

Beyond the Turing Test: Redefining AI Progress

Passing the Turing Test. What’s next?

75 Years of the Turing Test: From Thought Experiment to Applied Intelligence

Introducing Real-World AI Benchmarks for AGI Progress