Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 45% depth#082 · needle at 52% depth#083 · needle at 36% depth#084 · needle at 3% depth#085 · needle at 77% depth#086 · needle at 23% depth#087 · needle at 51% depth#088 · needle at 43% depth#089 · needle at 87% depth#090 · needle at 72% depth#091 · needle at 11% depth#092 · needle at 89% depth#093 · needle at 58% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for festive-latter is: 5953273.
One of the special magic numbers for fuzzy-lady is: 9443756.
[… 67 lines omitted for display …]
One of the special magic numbers for steadfast-monument is: 6037050.
One of the special magic numbers for absent-skyline is: 5929261.
One of the special magic numbers for distinct-glut is: 5742703.
One of the special magic numbers for bashful-world is: 4044079.
One of the special magic numbers for hurried-secretary is: 8524258.
One of the special magic numbers for synonymous-pirate is: 1609875.
One of the special magic numbers for yellow-examiner is: 4829723.
One of the special magic numbers for threatening-briefing is: 8445699.
One of the special magic numbers for dashing-monk is: 5142337.
One of the special magic numbers for selfish-walk is: 8510459.
One of the special magic numbers for uptight-exception is: 8025252.
One of the special magic numbers for panicky-compassionate is: 7529506.
One of the special magic numbers for nice-buy is: 1608572.
One of the special magic numbers for tawdry-personnel is: 7496851.
[… 59 lines omitted for display …]
One of the special magic numbers for dysfunctional-shanty is: 6963362.
One of the special magic numbers for obedient-hunchback is: 6040687.
What is the special magic number for threatening-briefing mentioned in the provided text?
Original prompt 3,454 tokens, 146 linesShown 20 lines around the needleNeedle at 51% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3414090Aux 20158445699Ours8445699Ours, no steer.8445699PiT-FT3414090Qwen 27B8445699
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8445699.

13 characters10 tokens

Aux 2015

Found the needle

:

8445699

14 characters12 tokens

PiT-FT 2015

Missed

: 8588068 <|assistant|> The special magic number for tacit-neuron mentioned in the provided text is: 8588068 <|assistant|> The special magic number for tacit-neuron mentioned in the provided text is: 8588068 <|assistant|> The special magic number for tacit-neuron mentioned in the provided text is: 8588068 <|assistant|> The special magic number for tacit-neuron mentioned in the provided text is: 8588068 <|assistant|> The special magic

442 characters128 tokens

ChronoGPT 2015

Missed

: 8588068.<|endoftext|>

23 characters7 tokens