Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#044 · needle at 50% depth #045 · needle at 36% depth #046 · needle at 27% depth #047 · needle at 2% depth #048 · needle at 27% depth #049 · needle at 71% depth #050 · needle at 92% depth #051 · needle at 87% depth #052 · needle at 72% depth #053 · needle at 33% depth #054 · needle at 10% depth #055 · needle at 3% depth #056 · needle at 67% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for glamorous-baseline is: 3608321.
One of the special magic numbers for powerful-shopping is: 9481962.
[… 126 lines omitted for display …]
One of the special magic numbers for fancy-cousin is: 2348637.
One of the special magic numbers for materialistic-speculation is: 4255084.
One of the special magic numbers for obscene-crayon is: 1659976.
One of the special magic numbers for jazzy-membrane is: 1180863.
One of the special magic numbers for agonizing-prince is: 5885614.
One of the special magic numbers for solid-judo is: 4326662.
One of the special magic numbers for exultant-builder is: 4099584.
One of the special magic numbers for momentous-cliff is: 8698024.
One of the special magic numbers for educated-alcohol is: 5258144.
One of the special magic numbers for gullible-tomorrow is: 7320566.
One of the special magic numbers for psychotic-shoreline is: 8056683.
One of the special magic numbers for smoggy-graduation is: 4756028.
One of the special magic numbers for combative-tube is: 8391531.
One of the special magic numbers for diligent-settlement is: 5674754.
One of the special magic numbers for obedient-preoccupation is: 8268414.
One of the special magic numbers for frail-toothpick is: 1089412.
What is the special magic number for psychotic-shoreline mentioned in the provided text?

Original prompt 3,458 tokens, 146 linesShown 20 lines around the needleNeedle at 92% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT5330840Aux 20158056683Ours8056683Ours, no steer.8056683PiT-FT5330840Qwen 27B8056683

Ours

Found the needle

8056683.

Aux 2015

Found the needle

8056683.

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

ChronoGPT 2015

Missed

: 9853438.<|endoftext|>