Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 65% depth #016 · needle at 28% depth #017 · needle at 73% depth #018 · needle at 59% depth #019 · needle at 32% depth #020 · needle at 71% depth #021 · needle at 51% depth #022 · needle at 77% depth #023 · needle at 37% depth #024 · needle at 68% depth #025 · needle at 34% depth #026 · needle at 95% depth #027 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bright-sushi is: 5988439.
One of the special magic numbers for silent-thrill is: 8736886.
[… 70 lines omitted for display …]
One of the special magic numbers for ahead-choir is: 8457126.
One of the special magic numbers for amuck-reef is: 6951329.
One of the special magic numbers for dashing-embarrassment is: 8850178.
One of the special magic numbers for worried-flour is: 8689839.
One of the special magic numbers for grumpy-last is: 1153009.
One of the special magic numbers for different-snap is: 7002009.
One of the special magic numbers for puny-cytokine is: 9442389.
One of the special magic numbers for hissing-genetics is: 6116985.
One of the special magic numbers for faded-query is: 6852464.
One of the special magic numbers for weary-lookout is: 9808972.
One of the special magic numbers for magenta-chuck is: 9607469.
One of the special magic numbers for bashful-parole is: 3927571.
One of the special magic numbers for tranquil-eligibility is: 3540116.
One of the special magic numbers for kind-crepe is: 6692359.
[… 61 lines omitted for display …]
One of the special magic numbers for robust-ambiguity is: 5049993.
One of the special magic numbers for raspy-harbour is: 9389396.
What is the special magic number for hissing-genetics mentioned in the provided text?

Original prompt 3,558 tokens, 151 linesShown 20 lines around the needleNeedle at 51% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3756096Aux 20157984561Ours6116985Ours, no steer.6116985PiT-FT3756096Qwen 27B6116985

Ours

Found the needle

6116985.

Aux 2015

Found the needle

7984561.

PiT-FT 2015

Missed

: <|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<|<

ChronoGPT 2015

Missed

: 7590085.<|endoftext|>