Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 24% depth#061 · needle at 10% depth#062 · needle at 61% depth#063 · needle at 40% depth#064 · needle at 41% depth#065 · needle at 41% depth#066 · needle at 2% depth#067 · needle at 82% depth#068 · needle at 8% depth#069 · needle at 77% depth#070 · needle at 38% depth#071 · needle at 65% depth#072 · needle at 34% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for poised-capital is: 5029094.
One of the special magic numbers for level-confidence is: 6973457.
One of the special magic numbers for envious-specialist is: 8187968.
One of the special magic numbers for watchful-socialist is: 9844749.
One of the special magic numbers for squalid-centre is: 7837038.
One of the special magic numbers for animated-democracy is: 9204893.
One of the special magic numbers for average-jump is: 8624482.
One of the special magic numbers for cultured-hobbit is: 3228675.
One of the special magic numbers for roasted-involvement is: 4597014.
One of the special magic numbers for greedy-beanie is: 2432350.
One of the special magic numbers for fallacious-dare is: 4866878.
One of the special magic numbers for jolly-cummerbund is: 2786278.
One of the special magic numbers for encouraging-savory is: 1122496.
One of the special magic numbers for blushing-approval is: 5565163.
One of the special magic numbers for elite-insurgence is: 1790682.
One of the special magic numbers for stereotyped-neighborhood is: 8853339.
[… 131 lines omitted for display …]
One of the special magic numbers for open-gravitas is: 7154527.
One of the special magic numbers for gruesome-sinuosity is: 9630184.
What is the special magic number for envious-specialist mentioned in the provided text?
Original prompt 3,570 tokens, 151 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4535058Aux 20158187968Ours8187968Ours, no steer.8187968PiT-FT4535058Qwen 27B8187968
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8187968.

13 characters10 tokens

Aux 2015

Found the needle

:

8187968

14 characters12 tokens

PiT-FT 2015

Missed

: 7648252 <|assistant|> The special magic number for rare-coast mentioned in the provided text is: 7648252 <|assistant|> The special magic number for rare-coast mentioned in the provided text is: 7648252 <|assistant|> The special magic number for rare-coast mentioned in the provided text is: 7648252 <|assistant|> The special magic number for rare-coast mentioned in the provided text is: 7648252 <|assistant|> The special magic number for rare-co

453 characters128 tokens

ChronoGPT 2015

Missed

: 5136836.<|endoftext|>

23 characters7 tokens