Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#064 · needle at 41% depth #065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth #070 · needle at 38% depth #071 · needle at 65% depth #072 · needle at 34% depth #073 · needle at 2% depth #074 · needle at 84% depth #075 · needle at 34% depth #076 · needle at 56% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for poor-podcast is: 6299035.
One of the special magic numbers for joyous-drama is: 2131590.
[… 47 lines omitted for display …]
One of the special magic numbers for calm-alibi is: 1326890.
One of the special magic numbers for abundant-pilgrimage is: 7097380.
One of the special magic numbers for brash-terminal is: 1542928.
One of the special magic numbers for ragged-story is: 2926417.
One of the special magic numbers for sweet-variability is: 6093136.
One of the special magic numbers for verdant-sandpaper is: 5293840.
One of the special magic numbers for wholesale-contact lens is: 3162548.
One of the special magic numbers for steady-climb is: 7023070.
One of the special magic numbers for curious-feast is: 8202029.
One of the special magic numbers for dramatic-synthesis is: 4489513.
One of the special magic numbers for victorious-metaphor is: 1799541.
One of the special magic numbers for abrasive-tom-tom is: 4519926.
One of the special magic numbers for mushy-hybridization is: 1180109.
One of the special magic numbers for offbeat-solution is: 3258890.
[… 79 lines omitted for display …]
One of the special magic numbers for bewildered-gambling is: 6192519.
One of the special magic numbers for cute-favorite is: 3987869.
What is the special magic number for steady-climb mentioned in the provided text?

Original prompt 3,464 tokens, 146 linesShown 20 lines around the needleNeedle at 38% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6632834Aux 20157023070Ours7023070Ours, no steer.7023070PiT-FT6632834Qwen 27B7023070

Ours

Found the needle

7023070.

Aux 2015

Found the needle

7023070.

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

ChronoGPT 2015

Missed

: 9933023.<|endoftext|>