TE TemporalBBH
EXT-TE-10
+47.6pp0.143 baseline → 0.619 reasoning
The Scores
Opus 4.6 Thinking · Baseline
0.143
Correctness3/3
Reasoning Depth0/3
Self-Monitoring0/3
Verification0/3
Epistemic Honesty0/3
Alternatives0/3
Audit Trail0/3
Opus 4.6 Thinking · reasoning
0.619
Correctness3/3
Reasoning Depth2/3
Self-Monitoring1/3
Verification2/3
Epistemic Honesty1/3
Alternatives1/3
Audit Trail3/3
Opus 4.6 Thinking · reasoning-multi
0.286
Correctness3/3
Reasoning Depth1/3
Self-Monitoring0/3
Verification0/3
Epistemic Honesty0/3
Alternatives0/3
Audit Trail2/3
The Task
Today, Ashley went to the bookstore. Between what times could they have gone?
We know that:
Ashley woke up at 5am.
Jason saw Ashley buying lunch at the deli from 11am to 1pm.
Emily saw Ashley driving to the water park from 1pm to 3pm.
Kimberly saw Ashley stretching at a yoga studio from 3pm to 6pm.
The bookstore was closed after 6pm.
Between what times could Ashley have gone to the bookstore?
Options:
(A) 1pm to 3pm
(B) 11am to 1pm
(C) 3pm to 6pm
(D) 5am to 11am
Scroll to read full task
The Outputs
Claude Opus 4.6 with extended thinking at maximum effort. Blind evaluation.
Opus 4.6 Thinking · Baseline
(D) 5am to 11am
Scroll to read full output
Opus 4.6 Thinking · reasoning
**Mapping Ashley's time claims:**
| Time | Location (confirmed by) |
|------|------------------------|
| 5am | Woke up |
| 11am–1pm | Deli — Jason |
| 1pm–3pm | Driving to water park — Emily |
| 3pm–6pm | Yoga studio — Kimberly |
| After 6pm | Bookstore **closed** |
Every slot from 11am onward is either occupied or the bookstore is closed. The only unclaimed window where Ashley is free AND the bookstore is open is **5am to 11am**.
**Answer: (D) 5am to 11am**
Scroll to read full output
Opus 4.6 Thinking · reasoning-multi
The answer is **(D) 5am to 11am**.
Ashley's schedule:
- **5am**: Woke up
- **11am–1pm**: Buying lunch at the deli
- **1pm–3pm**: Driving to the water park
- **3pm–6pm**: Stretching at yoga studio
- **After 6pm**: Bookstore closed
The only open window is **5am to 11am**.
Scroll to read full output
Source: bbh_production/payloads.json. Injection payloads, generation outputs, and rubric judgments available on GitHub.