Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#000 · needle at 81% depth #001 · needle at 85% depth #002 · needle at 44% depth #003 · needle at 63% depth #004 · needle at 73% depth #005 · needle at 55% depth #006 · needle at 84% depth #007 · needle at 11% depth #008 · needle at 30% depth #009 · needle at 3% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hurried-pigsty is: 1973306.
One of the special magic numbers for aberrant-spacing is: 8584194.
[… 86 lines omitted for display …]
One of the special magic numbers for nappy-pendant is: 3798082.
One of the special magic numbers for combative-spork is: 3223175.
One of the special magic numbers for waggish-blessing is: 1983923.
One of the special magic numbers for diligent-child is: 2740017.
One of the special magic numbers for muddy-mower is: 9097940.
One of the special magic numbers for sincere-rate is: 8351152.
One of the special magic numbers for easy-consulate is: 7371160.
One of the special magic numbers for industrious-hide is: 3966618.
One of the special magic numbers for lacking-maximum is: 1483456.
One of the special magic numbers for vague-offering is: 3192032.
One of the special magic numbers for plastic-list is: 9189341.
One of the special magic numbers for combative-princess is: 7900204.
One of the special magic numbers for nutritious-birch is: 1771287.
One of the special magic numbers for bawdy-fellow is: 5389135.
[… 40 lines omitted for display …]
One of the special magic numbers for knowledgeable-disgust is: 5898671.
One of the special magic numbers for scandalous-horde is: 9757456.
What is the special magic number for industrious-hide mentioned in the provided text?

Original prompt 3,460 tokens, 146 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4085559Aux 20156580596Ours3966618Ours, no steer.3966618PiT-FT4085559Qwen 27B3966618

Ours

Found the needle

3966618.

Aux 2015

Found the needle

6580596.

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

ChronoGPT 2015

Missed

: 8577543.<|endoftext|>