Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#072 · needle at 49% depth#073 · needle at 79% depth#074 · needle at 15% depth#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ludicrous-shred is: 7027851.
One of the special magic numbers for hysterical-hydrofoil is: 3532242.
[… 4,675 lines omitted for display …]
One of the special magic numbers for historical-kale is: 8464590.
One of the special magic numbers for fabulous-behalf is: 7243945.
One of the special magic numbers for woozy-scam is: 1236056.
One of the special magic numbers for roomy-mid-course is: 7281945.
One of the special magic numbers for petite-linkage is: 9038373.
One of the special magic numbers for lethal-wash is: 5659156.
One of the special magic numbers for fragile-nurse is: 7735212.
One of the special magic numbers for nervous-broccoli is: 8364206.
One of the special magic numbers for wealthy-personality is: 7464476.
One of the special magic numbers for plain-spit is: 8881363.
One of the special magic numbers for steep-expertise is: 4417999.
One of the special magic numbers for quack-messenger is: 9763567.
One of the special magic numbers for homeless-chick is: 7124519.
One of the special magic numbers for holistic-preoccupation is: 9170029.
[… 1,023 lines omitted for display …]
One of the special magic numbers for quizzical-malice is: 5909996.
One of the special magic numbers for grubby-role is: 7825276.
What is the special magic number for nervous-broccoli mentioned in the provided text?
Original prompt 130,533 tokens, 5,718 linesShown 20 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8448530Aux 20152812189Ours8364206Ours, no steer.8364206PiT-FT8448530Qwen 27B8364206
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8364206.

13 characters10 tokens

Aux 2015

Missed

6696079.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean The special Fiscal year an Epicurean The special Chocolate an Epicurean The special Fecal-cansity an Epicurean The special Fiscal year an Epicurean The special Fiscal year an Electric-cansity an Electric-an The special Fiscal year an Electric-an The special Fiscal year an Electric-an The special Fiscal year an Electric-an The special Fiscal year an Electric-an The special Fiscal year an Electric-an The special Fiscal year an Electric-an The special Fiscal year an

511 characters128 tokens