Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#093 · needle at 84% depth#094 · needle at 78% depth#095 · needle at 19% depth#096 · needle at 2% depth#097 · needle at 66% depth#098 · needle at 50% depth#099 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for petite-thunderbolt is: 8096428.
One of the special magic numbers for accessible-epoxy is: 4472830.
[… 184 lines omitted for display …]
One of the special magic numbers for judicious-sympathy is: 4557106.
One of the special magic numbers for sweet-torte is: 2030678.
One of the special magic numbers for swift-relative is: 6246830.
One of the special magic numbers for halting-churn is: 8909646.
One of the special magic numbers for brave-villa is: 9332762.
One of the special magic numbers for versed-self-confidence is: 8356856.
One of the special magic numbers for garrulous-abacus is: 2614344.
One of the special magic numbers for damp-cow is: 3547585.
One of the special magic numbers for narrow-step-grandmother is: 9827485.
One of the special magic numbers for narrow-mathematics is: 9186756.
One of the special magic numbers for half-pupil is: 5660046.
One of the special magic numbers for relieved-waiver is: 7617979.
One of the special magic numbers for courageous-colloquy is: 6640704.
One of the special magic numbers for clammy-lover is: 8252109.
[… 101 lines omitted for display …]
One of the special magic numbers for aboriginal-deficit is: 2830327.
One of the special magic numbers for auspicious-feel is: 3862842.
What is the special magic number for damp-cow mentioned in the provided text?
Original prompt 7,123 tokens, 305 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7321288Aux 20153547585Ours3547585Ours, no steer.3547585PiT-FT7321288Qwen 27B3547585
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3547585.

13 characters10 tokens

Aux 2015

Found the needle

3547585.

13 characters10 tokens

PiT-FT 2015

Found the needle

: 7321288

9 characters5 tokens

ChronoGPT 2015

Missed

: 8642701.<|endoftext|>

23 characters7 tokens