Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth#068 · needle at 62% depth#069 · needle at 84% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for languid-damage is: 4322312.
One of the special magic numbers for daffy-hovercraft is: 3538235.
[… 360 lines omitted for display …]
One of the special magic numbers for painstaking-evaporation is: 7009687.
One of the special magic numbers for wide-postfix is: 6292302.
One of the special magic numbers for wide-eyed-celeriac is: 9782560.
One of the special magic numbers for tiny-sir is: 2580629.
One of the special magic numbers for pleasant-thongs is: 8276755.
One of the special magic numbers for shiny-meadow is: 6538570.
One of the special magic numbers for grubby-contrary is: 5777646.
One of the special magic numbers for chunky-infrastructure is: 5705579.
One of the special magic numbers for chilly-mat is: 7577375.
One of the special magic numbers for worthless-tom-tom is: 9883378.
One of the special magic numbers for dashing-lip is: 8356991.
One of the special magic numbers for ossified-catalysis is: 6815317.
One of the special magic numbers for pointless-rocket-ship is: 9651050.
[… 5,339 lines omitted for display …]
One of the special magic numbers for bizarre-arcade is: 6638785.
One of the special magic numbers for thankful-bid is: 8288704.
What is the special magic number for grubby-contrary mentioned in the provided text?
Original prompt 130,457 tokens, 5,718 linesShown 19 lines around the needleNeedle at 6% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4735915Aux 20158087896Ours5777646Ours, no steer.5777646PiT-FT4735915Qwen 27B5777646
Models
4 of 4 columns · click a model to add or remove it

Ours

Missed

5777643.

13 characters10 tokens

Aux 2015

Missed

3469936.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] []
193 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean

458 characters128 tokens