Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for expensive-collectivisation is: 3339765.
One of the special magic numbers for victorious-cruise is: 7671261.
[… 4,113 lines omitted for display …]
One of the special magic numbers for foregoing-goat is: 8792539.
One of the special magic numbers for determined-tam-o'-shanter is: 1604944.
One of the special magic numbers for longing-reindeer is: 6532867.
One of the special magic numbers for discreet-freedom is: 5671754.
One of the special magic numbers for painstaking-vestment is: 9614914.
One of the special magic numbers for nonchalant-tea is: 9101709.
One of the special magic numbers for rhetorical-trust is: 3163609.
One of the special magic numbers for unable-printer is: 5229211.
One of the special magic numbers for obscene-basketball is: 2265743.
One of the special magic numbers for barbarous-blend is: 8646753.
One of the special magic numbers for juicy-vein is: 6808822.
One of the special magic numbers for festive-second is: 9452772.
One of the special magic numbers for wanting-cylinder is: 1151550.
One of the special magic numbers for tense-consumer is: 2076698.
[… 1,585 lines omitted for display …]
One of the special magic numbers for axiomatic-engine is: 4611610.
One of the special magic numbers for willing-critic is: 8734778.
What is the special magic number for unable-printer mentioned in the provided text?
Original prompt 130,529 tokens, 5,718 linesShown 20 lines around the needleNeedle at 72% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5484341Aux 20159702459Ours5229211Ours, no steer.5229211PiT-FT5484341Qwen 27B5229211
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5229211.

13 characters10 tokens

Aux 2015

Missed

8948740.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean Elysian The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicure

463 characters128 tokens