Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#024 · needle at 37% depth #025 · needle at 64% depth #026 · needle at 93% depth #027 · needle at 50% depth #028 · needle at 72% depth #029 · needle at 68% depth #030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth #033 · needle at 20% depth #034 · needle at 52% depth #035 · needle at 72% depth #036 · needle at 26% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for decisive-reef is: 9184794.
One of the special magic numbers for economic-igloo is: 5691746.
[… 9 lines omitted for display …]
One of the special magic numbers for spicy-cascade is: 8144753.
One of the special magic numbers for diligent-mussel is: 3762984.
One of the special magic numbers for guiltless-prophet is: 5831487.
One of the special magic numbers for wet-topic is: 7167441.
One of the special magic numbers for cowardly-slipper is: 1363733.
One of the special magic numbers for horrible-lieutenant is: 7824904.
One of the special magic numbers for tall-pear is: 3316762.
One of the special magic numbers for lewd-classmate is: 2067260.
One of the special magic numbers for hushed-laptop is: 1097535.
One of the special magic numbers for momentous-coin is: 3174559.
One of the special magic numbers for silky-top-hat is: 8026409.
One of the special magic numbers for imperfect-imprisonment is: 7426974.
One of the special magic numbers for roasted-earplug is: 6600282.
One of the special magic numbers for coherent-syrup is: 3399050.
[… 301 lines omitted for display …]
One of the special magic numbers for judicious-shoes is: 4695819.
One of the special magic numbers for blue-eyed-sanctuary is: 2481041.
What is the special magic number for lewd-classmate mentioned in the provided text?

Original prompt 7,643 tokens, 330 linesShown 20 lines around the needleNeedle at 6% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT5117463Aux 20152067260Ours2067260Ours, no steer.2067260PiT-FT5117463Qwen 27B2067260

Ours

Found the needle

2067260.

Aux 2015

Found the needle

2067260.

PiT-FT 2015

Missed

: 6166673 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 6145<|endoftext|>