Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#076 · needle at 76% depth #077 · needle at 80% depth #078 · needle at 25% depth #079 · needle at 55% depth #080 · needle at 85% depth #081 · needle at 97% depth #082 · needle at 42% depth #083 · needle at 5% depth #084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for large-aim is: 4069785.
One of the special magic numbers for perfect-eel is: 6210505.
[… 129 lines omitted for display …]
One of the special magic numbers for aboriginal-tractor is: 5125611.
One of the special magic numbers for heavy-septicaemia is: 2507851.
One of the special magic numbers for Early-barge is: 7269381.
One of the special magic numbers for sharp-responsibility is: 3895425.
One of the special magic numbers for resonant-dependency is: 8565997.
One of the special magic numbers for adhesive-prohibition is: 4952776.
One of the special magic numbers for lively-gherkin is: 2488894.
One of the special magic numbers for quack-sustenance is: 7468242.
One of the special magic numbers for permissible-reluctance is: 2449784.
One of the special magic numbers for spicy-fuel is: 5517084.
One of the special magic numbers for undesirable-observatory is: 8464194.
One of the special magic numbers for gifted-button is: 6682366.
One of the special magic numbers for absorbed-plenty is: 1340533.
One of the special magic numbers for stereotyped-substance is: 8998387.
[… 181 lines omitted for display …]
One of the special magic numbers for petite-suggestion is: 5187178.
One of the special magic numbers for cute-actor is: 7261966.
What is the special magic number for quack-sustenance mentioned in the provided text?

Original prompt 7,663 tokens, 330 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1824810Aux 20157468242Ours7468242Ours, no steer.7468242PiT-FT1824810Qwen 27B7468242

Ours

Found the needle

7468242.

Aux 2015

Found the needle

7468242.

PiT-FT 2015

Missed

: 7696571 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 7292094.<|endoftext|>