Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sincere-pioneer is: 9842680.
One of the special magic numbers for needless-awareness is: 6332228.
[… 971 lines omitted for display …]
One of the special magic numbers for homely-hardboard is: 8225100.
One of the special magic numbers for anxious-possibility is: 8123317.
One of the special magic numbers for longing-branch is: 5288669.
One of the special magic numbers for axiomatic-carp is: 7627392.
One of the special magic numbers for annoyed-silica is: 7596560.
One of the special magic numbers for aloof-boatyard is: 5047981.
One of the special magic numbers for dry-spud is: 8884666.
One of the special magic numbers for hungry-draft is: 9542809.
One of the special magic numbers for neighborly-knife is: 1153994.
One of the special magic numbers for average-sailing is: 6600961.
One of the special magic numbers for ancient-canon is: 5929396.
One of the special magic numbers for trite-depth is: 4144073.
One of the special magic numbers for wakeful-center is: 5716231.
One of the special magic numbers for disagreeable-laugh is: 4869285.
[… 417 lines omitted for display …]
One of the special magic numbers for fearless-mango is: 7454408.
One of the special magic numbers for murky-lemur is: 8893718.
What is the special magic number for hungry-draft mentioned in the provided text?
Original prompt 32,206 tokens, 1,408 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5333593Aux 20155606136Ours9542809Ours, no steer.9542809PiT-FT5333593Qwen 27B9542809
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9542809.

13 characters10 tokens

Aux 2015

Missed

7702235.

13 characters10 tokens

PiT-FT 2015

Missed

: 7596927. The special magic number for the obnoxious-catholic is: 8709101. The special magic number for the icky-cactus is: 8874316. The special magic number for the icky-cauliflower is: 8872061. The special magic number for the icky-cobra is: 8702036. The special magic number for the icky-cactus is: 8872061. The special magic number for the icky-cauliflower is: 8872061. The special magic number

406 characters128 tokens

ChronoGPT 2015

Missed

: 1878707.<|endoftext|>

23 characters6 tokens