Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth #092 · needle at 62% depth #093 · needle at 84% depth #094 · needle at 78% depth #095 · needle at 19% depth #096 · needle at 2% depth #097 · needle at 66% depth #098 · needle at 50% depth #099 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for spicy-thunderhead is: 9859906.
One of the special magic numbers for sharp-shipping is: 8913381.
[… 50 lines omitted for display …]
One of the special magic numbers for breezy-tomography is: 9049251.
One of the special magic numbers for cynical-gobbler is: 8740680.
One of the special magic numbers for guttural-advice is: 5975076.
One of the special magic numbers for open-daisy is: 4115063.
One of the special magic numbers for painful-storey is: 1719589.
One of the special magic numbers for kindhearted-workshop is: 5452921.
One of the special magic numbers for guiltless-camp is: 7339667.
One of the special magic numbers for chubby-red is: 4935837.
One of the special magic numbers for cheerful-worry is: 8546060.
One of the special magic numbers for festive-pub is: 6290822.
One of the special magic numbers for fine-coordination is: 7735172.
One of the special magic numbers for auspicious-faucet is: 8029317.
One of the special magic numbers for weary-pub is: 9394759.
One of the special magic numbers for hapless-use is: 5876633.
[… 235 lines omitted for display …]
One of the special magic numbers for steep-ridge is: 9818580.
One of the special magic numbers for steady-digging is: 3313369.
What is the special magic number for chubby-red mentioned in the provided text?

Original prompt 7,115 tokens, 305 linesShown 20 lines around the needleNeedle at 19% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2232107Aux 20154935837Ours4935837Ours, no steer.4935837PiT-FT2232107Qwen 27B4935837

Ours

Found the needle

4935837.

Aux 2015

Found the needle

4935837.

PiT-FT 2015

Missed

: 2088538 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 7387531.<|endoftext|>