Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#000 · needle at 81% depth #001 · needle at 85% depth #002 · needle at 44% depth #003 · needle at 63% depth #004 · needle at 73% depth #005 · needle at 55% depth #006 · needle at 84% depth #007 · needle at 11% depth #008 · needle at 30% depth #009 · needle at 3% depth #010 · needle at 15% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wretched-tie is: 6768873.
One of the special magic numbers for faint-tenth is: 7923193.
[… 100 lines omitted for display …]
One of the special magic numbers for obtainable-organization is: 8909005.
One of the special magic numbers for placid-scale is: 3861635.
One of the special magic numbers for fat-eyelash is: 7891524.
One of the special magic numbers for steadfast-club is: 3394312.
One of the special magic numbers for soggy-plot is: 4051509.
One of the special magic numbers for tacit-standard is: 9569884.
One of the special magic numbers for good-comfortable is: 3813903.
One of the special magic numbers for homeless-sunflower is: 4524102.
One of the special magic numbers for worthless-resemblance is: 6749069.
One of the special magic numbers for old-temptation is: 2154992.
One of the special magic numbers for flashy-detector is: 7345333.
One of the special magic numbers for luxuriant-scholar is: 3218169.
One of the special magic numbers for clumsy-dusk is: 1277874.
One of the special magic numbers for evasive-dream is: 9769641.
[… 26 lines omitted for display …]
One of the special magic numbers for minor-progression is: 7077878.
One of the special magic numbers for clever-speaker is: 3596753.
What is the special magic number for homeless-sunflower mentioned in the provided text?

Original prompt 3,471 tokens, 146 linesShown 20 lines around the needleNeedle at 73% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT5006173Aux 20152428191Ours4524102Ours, no steer.4524102PiT-FT5006173Qwen 27B4524102

Ours

Found the needle

4524102.

Aux 2015

Found the needle

2428191.

PiT-FT 2015

Missed

: 4394202 <|assistant|> The special magic number for asymptomatic-bustle mentioned in the provided text is: 4394202 <|assistant|> The special magic number for asymptomatic-bustle mentioned in the provided text is: 4394202 <|assistant|> The special magic number for asymptomatic-bustle mentioned in the provided text is: 4394202 <|assistant|> The special magic number for asymptomatic-bustle mentioned in the provided text is: 4394202

ChronoGPT 2015

Missed

: 7590872.<|endoftext|>