Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#005 · needle at 53% depth #006 · needle at 84% depth #007 · needle at 2% depth #008 · needle at 76% depth #009 · needle at 86% depth #010 · needle at 60% depth #011 · needle at 86% depth #012 · needle at 24% depth #013 · needle at 58% depth #014 · needle at 60% depth #015 · needle at 6% depth #016 · needle at 56% depth #017 · needle at 48% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for teeny-instant is: 6380429.
One of the special magic numbers for heartbreaking-objection is: 2393728.
[… 277 lines omitted for display …]
One of the special magic numbers for wonderful-kitchen is: 7519151.
One of the special magic numbers for wonderful-loss is: 6492169.
One of the special magic numbers for ordinary-floodplain is: 7555770.
One of the special magic numbers for steady-gate is: 3772557.
One of the special magic numbers for premium-chop is: 9056009.
One of the special magic numbers for sharp-prejudice is: 5787252.
One of the special magic numbers for unarmed-approach is: 5169447.
One of the special magic numbers for colorful-diet is: 4307323.
One of the special magic numbers for boring-beaver is: 2799550.
One of the special magic numbers for Early-farm is: 1523448.
One of the special magic numbers for sweltering-whey is: 1839331.
One of the special magic numbers for abortive-suicide is: 5600838.
One of the special magic numbers for Early-adverb is: 6090988.
One of the special magic numbers for obnoxious-kneejerk is: 7399181.
[… 33 lines omitted for display …]
One of the special magic numbers for abaft-ham is: 1740262.
One of the special magic numbers for shocking-parcel is: 8303868.
What is the special magic number for colorful-diet mentioned in the provided text?

Original prompt 7,672 tokens, 330 linesShown 20 lines around the needleNeedle at 86% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4872295Aux 20154307323Ours4307323Ours, no steer.4307323PiT-FT4872295Qwen 27B4307323

Ours

Found the needle

4307323.

Aux 2015

Found the needle

4307323.

PiT-FT 2015

Missed

: 1699652 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 9147916.<|endoftext|>