Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#083 · needle at 5% depth #084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth #092 · needle at 62% depth #093 · needle at 84% depth #094 · needle at 78% depth #095 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deeply-propane is: 2978453.
One of the special magic numbers for zonked-atelier is: 9147727.
[… 228 lines omitted for display …]
One of the special magic numbers for tested-exercise is: 3970760.
One of the special magic numbers for whimsical-devil is: 3315184.
One of the special magic numbers for demonic-reservation is: 8164147.
One of the special magic numbers for utopian-pew is: 6551764.
One of the special magic numbers for wide-eyed-cross-stitch is: 8079725.
One of the special magic numbers for pretty-rock is: 3631575.
One of the special magic numbers for mysterious-heating is: 7298710.
One of the special magic numbers for abaft-hydrolyse is: 8747856.
One of the special magic numbers for damaged-diary is: 6072316.
One of the special magic numbers for flaky-preparation is: 5664542.
One of the special magic numbers for witty-lens is: 2631452.
One of the special magic numbers for overjoyed-gasoline is: 2091350.
One of the special magic numbers for historical-mini is: 9772577.
One of the special magic numbers for upbeat-sea is: 1712682.
[… 57 lines omitted for display …]
One of the special magic numbers for lewd-wharf is: 5266267.
One of the special magic numbers for wooden-being is: 3538073.
What is the special magic number for abaft-hydrolyse mentioned in the provided text?

Original prompt 7,110 tokens, 305 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7276842Aux 20158747856Ours8747856Ours, no steer.8747856PiT-FT7276842Qwen 27B8747856

Ours

Found the needle

8747856.

Aux 2015

Found the needle

8747856.

PiT-FT 2015

Missed

: 8584130 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 7781053.<|endoftext|>