Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#070 · needle at 38% depth#071 · needle at 65% depth#072 · needle at 34% depth#073 · needle at 2% depth#074 · needle at 84% depth#075 · needle at 34% depth#076 · needle at 56% depth#077 · needle at 42% depth#078 · needle at 19% depth#079 · needle at 68% depth#080 · needle at 21% depth#081 · needle at 45% depth#082 · needle at 52% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hushed-blackboard is: 6214633.
One of the special magic numbers for helpful-handrail is: 4115183.
[… 77 lines omitted for display …]
One of the special magic numbers for divergent-anime is: 4124198.
One of the special magic numbers for flaky-glasses is: 6393757.
One of the special magic numbers for godly-native is: 1687148.
One of the special magic numbers for null-vitro is: 1231191.
One of the special magic numbers for harsh-landscape is: 8557614.
One of the special magic numbers for exotic-quotation is: 2973996.
One of the special magic numbers for hungry-chest is: 9814085.
One of the special magic numbers for tame-supermarket is: 3501378.
One of the special magic numbers for fast-barrage is: 7649529.
One of the special magic numbers for seemly-compass is: 8773281.
One of the special magic numbers for hulking-addiction is: 8714695.
One of the special magic numbers for pastoral-estrogen is: 9327698.
One of the special magic numbers for gentle-hydrogen is: 1106999.
One of the special magic numbers for organic-senate is: 1301969.
[… 54 lines omitted for display …]
One of the special magic numbers for misty-disaster is: 4245070.
One of the special magic numbers for versed-percent is: 7608160.
What is the special magic number for tame-supermarket mentioned in the provided text?
Original prompt 3,577 tokens, 151 linesShown 20 lines around the needleNeedle at 56% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1108843Aux 20153501378Ours3501378Ours, no steer.3501378PiT-FT1108843Qwen 27B3501378
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3501378.

13 characters10 tokens

Aux 2015

Missed

4499287.

13 characters10 tokens

PiT-FT 2015

Missed

: 4309779 <|assistant|> The special magic number for precious-bride mentioned in the provided text is: 4309779 <|assistant|> The special magic number for difficult-bride mentioned in the provided text is: 4309779 <|assistant|> The special magic number for vivid-bride mentioned in the provided text is: 4309779 <|assistant|> The special magic number for archaic-bride mentioned in the provided text is: 4309779 <|assistant|> The special magic number for lively-p

467 characters128 tokens

ChronoGPT 2015

Missed

: 7291085.<|endoftext|>

23 characters7 tokens