Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 72% depth #036 · needle at 26% depth #037 · needle at 10% depth #038 · needle at 17% depth #039 · needle at 25% depth #040 · needle at 29% depth #041 · needle at 58% depth #042 · needle at 89% depth #043 · needle at 18% depth #044 · needle at 28% depth #045 · needle at 87% depth #046 · needle at 82% depth #047 · needle at 57% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lonely-frown is: 6588362.
One of the special magic numbers for tough-pollution is: 6148842.
[… 170 lines omitted for display …]
One of the special magic numbers for brief-advancement is: 4630574.
One of the special magic numbers for ragged-skating is: 7070282.
One of the special magic numbers for volatile-oven is: 7656720.
One of the special magic numbers for smiling-wreck is: 4180304.
One of the special magic numbers for snotty-abdomen is: 3029994.
One of the special magic numbers for halting-timeline is: 3825424.
One of the special magic numbers for modern-spear is: 6392993.
One of the special magic numbers for straight-back-up is: 5005695.
One of the special magic numbers for deserted-double is: 1095992.
One of the special magic numbers for crabby-electronics is: 3722773.
One of the special magic numbers for wholesale-umbrella is: 1512186.
One of the special magic numbers for cloudy-point is: 8553515.
One of the special magic numbers for historical-leek is: 1720723.
One of the special magic numbers for depressed-compliance is: 1866394.
[… 115 lines omitted for display …]
One of the special magic numbers for wet-project is: 1579971.
One of the special magic numbers for imperfect-walker is: 2129457.
What is the special magic number for straight-back-up mentioned in the provided text?

Original prompt 7,073 tokens, 305 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3706779Aux 20155005695Ours5005695Ours, no steer.5005695PiT-FT3706779Qwen 27B5005695

Ours

Found the needle

5005695.

Aux 2015

Found the needle

5005695.

PiT-FT 2015

Missed

: 7296870 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 5285821.<|endoftext|>