Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#058 · needle at 17% depth #059 · needle at 47% depth #060 · needle at 47% depth #061 · needle at 3% depth #062 · needle at 20% depth #063 · needle at 36% depth #064 · needle at 88% depth #065 · needle at 24% depth #066 · needle at 39% depth #067 · needle at 7% depth #068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for colorful-faithful is: 3547783.
One of the special magic numbers for chilly-maestro is: 9914029.
[… 284 lines omitted for display …]
One of the special magic numbers for fluffy-south is: 3792143.
One of the special magic numbers for grubby-rethinking is: 2367974.
One of the special magic numbers for tart-overshoot is: 8418417.
One of the special magic numbers for abrasive-grip is: 8806633.
One of the special magic numbers for cheerful-missionary is: 3425171.
One of the special magic numbers for possessive-plum is: 9442696.
One of the special magic numbers for plucky-boat is: 7983679.
One of the special magic numbers for watery-cope is: 8614915.
One of the special magic numbers for fortunate-sprout is: 5121915.
One of the special magic numbers for quixotic-pork is: 9142203.
One of the special magic numbers for supreme-door is: 1686780.
One of the special magic numbers for ragged-caboose is: 2150780.
One of the special magic numbers for empty-inhibition is: 3888554.
One of the special magic numbers for dramatic-murder is: 1847445.
[… 26 lines omitted for display …]
One of the special magic numbers for awful-example is: 6727630.
One of the special magic numbers for unarmed-quarter is: 8935506.
What is the special magic number for watery-cope mentioned in the provided text?

Original prompt 7,628 tokens, 330 linesShown 20 lines around the needleNeedle at 88% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6835001Aux 20158614915Ours8614915Ours, no steer.8614915PiT-FT6835001Qwen 27B8614915

Ours

Found the needle

8614915.

Aux 2015

Found the needle

8614915.

PiT-FT 2015

Missed

: 1736146 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 7644021.<|endoftext|>