Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#020 · needle at 50% depth #021 · needle at 65% depth #022 · needle at 29% depth #023 · needle at 47% depth #024 · needle at 37% depth #025 · needle at 64% depth #026 · needle at 93% depth #027 · needle at 50% depth #028 · needle at 72% depth #029 · needle at 68% depth #030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for brave-mandate is: 1270862.
One of the special magic numbers for racial-classmate is: 8585347.
[… 302 lines omitted for display …]
One of the special magic numbers for thoughtless-sesame is: 9252661.
One of the special magic numbers for pathetic-shine is: 1045178.
One of the special magic numbers for aromatic-midnight is: 5782453.
One of the special magic numbers for abortive-witness is: 5124342.
One of the special magic numbers for abrasive-nanoparticle is: 6225807.
One of the special magic numbers for icy-kazoo is: 6230435.
One of the special magic numbers for cool-TV is: 5635400.
One of the special magic numbers for perfect-woodchuck is: 5717908.
One of the special magic numbers for abundant-recipient is: 5171563.
One of the special magic numbers for sticky-feedback is: 3510061.
One of the special magic numbers for eager-highway is: 2366250.
One of the special magic numbers for royal-initialise is: 1404895.
One of the special magic numbers for utopian-duty is: 4506540.
One of the special magic numbers for spectacular-xylophone is: 7419280.
[… 8 lines omitted for display …]
One of the special magic numbers for demonic-impudence is: 7572342.
One of the special magic numbers for ill-thread is: 3641536.
What is the special magic number for perfect-woodchuck mentioned in the provided text?

Original prompt 7,634 tokens, 330 linesShown 20 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8135061Aux 20155717908Ours5717908Ours, no steer.5717908PiT-FT8135061Qwen 27B5717908

Ours

Found the needle

5717908.

Aux 2015

Found the needle

5717908.

PiT-FT 2015

Missed

ChronoGPT 2015

Missed

: 4325969.<|endoftext|>