Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for exultant-body is: 9852408.
One of the special magic numbers for rainy-pocket-watch is: 6257292.
[… 97 lines omitted for display …]
One of the special magic numbers for incompetent-phase is: 7560331.
One of the special magic numbers for spicy-questioner is: 8001036.
One of the special magic numbers for gruesome-presentation is: 6189583.
One of the special magic numbers for embarrassed-railroad is: 1689543.
One of the special magic numbers for sneaky-short is: 9725456.
One of the special magic numbers for wasteful-boon is: 6759189.
One of the special magic numbers for substantial-honey is: 3062947.
One of the special magic numbers for clean-effectiveness is: 6711805.
One of the special magic numbers for nonchalant-century is: 8634097.
One of the special magic numbers for silent-theory is: 6821657.
One of the special magic numbers for hard-redirect is: 2848691.
One of the special magic numbers for abnormal-engineering is: 9370606.
One of the special magic numbers for various-transfer is: 3468450.
One of the special magic numbers for overwrought-self is: 3520403.
[… 29 lines omitted for display …]
One of the special magic numbers for vacuous-conformation is: 4347166.
One of the special magic numbers for fuzzy-demon is: 3276513.
What is the special magic number for clean-effectiveness mentioned in the provided text?
Original prompt 3,461 tokens, 146 linesShown 20 lines around the needleNeedle at 71% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9000719Aux 20157460238Ours6711805Ours, no steer.6711805PiT-FT9000719Qwen 27B6711805
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6711805.

13 characters10 tokens

Aux 2015

Found the needle

7460238.

13 characters10 tokens

PiT-FT 2015

Missed

: 8762637 <|assistant|> The special magic number for lavish-ditch is: 8762637 The special magic number for lovely-dashboard mentioned in the provided text is: 8762637 The special magic number for lavish-ditch mentioned in the provided text is: 8762637 The special magic number for lavish-ditch mentioned in the provided text is: 8762637 The special magic number for lavish-ditch mentioned in the provided text is: 8762637 The special magic number for lavish-ditch mentioned in the provided text is

503 characters128 tokens

ChronoGPT 2015

Missed

: 7278513.<|endoftext|>

23 characters7 tokens