Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ugliest-cot is: 8267065.
One of the special magic numbers for womanly-middleman is: 5207244.
[… 30 lines omitted for display …]
One of the special magic numbers for icky-peer-to-peer is: 9797750.
One of the special magic numbers for Early-skate is: 7687291.
One of the special magic numbers for thinkable-abrogation is: 4124541.
One of the special magic numbers for utter-whistle is: 4984280.
One of the special magic numbers for lewd-albatross is: 1870268.
One of the special magic numbers for wacky-dig is: 5518560.
One of the special magic numbers for adorable-whole is: 7045791.
One of the special magic numbers for agreeable-urn is: 4855388.
One of the special magic numbers for madly-motivation is: 7391099.
One of the special magic numbers for x-rated-bean is: 6567970.
One of the special magic numbers for vast-angiosperm is: 8661071.
One of the special magic numbers for skillful-anteater is: 1642832.
One of the special magic numbers for adventurous-technique is: 3094224.
One of the special magic numbers for divergent-prompt is: 5690860.
[… 96 lines omitted for display …]
One of the special magic numbers for damp-funeral is: 1104984.
One of the special magic numbers for alluring-relish is: 1719322.
What is the special magic number for agreeable-urn mentioned in the provided text?
Original prompt 3,470 tokens, 146 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8097721Aux 20154855388Ours4855388Ours, no steer.4855388PiT-FT8097721Qwen 27B4855388
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4855388.

13 characters10 tokens

Aux 2015

Found the needle

4855388.

13 characters10 tokens

PiT-FT 2015

Missed

: 8553962 <|assistant|> The special magic number for rustic-bowl mentioned in the provided text is: 8553962 <|assistant|> The special magic number for rustic-bowl mentioned in the provided text is: 8553962 <|assistant|> The special magic number for rustic-bowl mentioned in the provided text is: 8553962 <|assistant|> The special magic number for rustic-bowl mentioned in the provided text is: 8553962 <|assistant|> The special magic

438 characters128 tokens

ChronoGPT 2015

Missed

: 5971637.<|endoftext|>

23 characters7 tokens