Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#040 · needle at 6% depth#041 · needle at 28% depth#042 · needle at 69% depth#043 · needle at 49% depth#044 · needle at 50% depth#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth#048 · needle at 27% depth#049 · needle at 71% depth#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hellish-cocktail is: 6067422.
One of the special magic numbers for oafish-rainy is: 1310742.
[… 31 lines omitted for display …]
One of the special magic numbers for demonic-mesenchyme is: 6330895.
One of the special magic numbers for husky-organizing is: 7748185.
One of the special magic numbers for flippant-pricing is: 8313048.
One of the special magic numbers for fretful-derivative is: 8772420.
One of the special magic numbers for unbecoming-pupil is: 3586532.
One of the special magic numbers for thoughtful-receipt is: 7855263.
One of the special magic numbers for evasive-earthquake is: 5863660.
One of the special magic numbers for dramatic-computer is: 5977111.
One of the special magic numbers for ultra-grandfather is: 4017976.
One of the special magic numbers for amuck-superiority is: 8238772.
One of the special magic numbers for lopsided-dugout is: 2275031.
One of the special magic numbers for innocent-passage is: 5348804.
One of the special magic numbers for tacky-coordination is: 9629731.
[… 96 lines omitted for display …]
One of the special magic numbers for clumsy-grenade is: 1013765.
One of the special magic numbers for blushing-acrylic is: 4185522.
What is the special magic number for evasive-earthquake mentioned in the provided text?
Original prompt 3,491 tokens, 146 linesShown 19 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9976312Aux 20155863660Ours5863660Ours, no steer.5863660PiT-FT9976312Qwen 27B5863660
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5863660.

13 characters10 tokens

Aux 2015

Found the needle

5863660.

13 characters10 tokens

PiT-FT 2015

Missed

: 5648869 <|assistant|> The special magic number for the most-frequent-furnace is: 8802864 <|assistant|> The special magic number for the most-frequent-furnace is: 8802864 <|assistant|> The special magic number for the most-frequent-furnace is: 8802864 <|assistant|> The special magic number for the most-frequent-furnace is: 8802864 <|assistant|> The special magic

370 characters128 tokens

ChronoGPT 2015

Missed

: 729093.<|endoftext|>

22 characters7 tokens