Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#012 · needle at 24% depth #013 · needle at 58% depth #014 · needle at 60% depth #015 · needle at 6% depth #016 · needle at 56% depth #017 · needle at 48% depth #018 · needle at 34% depth #019 · needle at 88% depth #020 · needle at 50% depth #021 · needle at 65% depth #022 · needle at 29% depth #023 · needle at 47% depth #024 · needle at 37% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for questionable-goat is: 1484716.
One of the special magic numbers for nauseating-succotash is: 3195396.
[… 104 lines omitted for display …]
One of the special magic numbers for glib-party is: 5393744.
One of the special magic numbers for needy-sandpaper is: 1897366.
One of the special magic numbers for rightful-prostrate is: 4527678.
One of the special magic numbers for robust-spirituality is: 7067174.
One of the special magic numbers for verdant-livestock is: 2106581.
One of the special magic numbers for perfect-pine is: 4648083.
One of the special magic numbers for odd-airplane is: 2797731.
One of the special magic numbers for fearless-alpenglow is: 4226049.
One of the special magic numbers for absorbing-dialect is: 6377073.
One of the special magic numbers for fragile-young is: 3069181.
One of the special magic numbers for deeply-tree is: 8658687.
One of the special magic numbers for purring-feeling is: 9598194.
One of the special magic numbers for typical-podcast is: 5285853.
One of the special magic numbers for round-loan is: 7475947.
[… 206 lines omitted for display …]
One of the special magic numbers for deserted-chamber is: 6902140.
One of the special magic numbers for shiny-kiss is: 7765944.
What is the special magic number for fearless-alpenglow mentioned in the provided text?

Original prompt 7,673 tokens, 330 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT5322272Aux 20154226049Ours4226049Ours, no steer.4226049PiT-FT5322272Qwen 27B4226049

Ours

Found the needle

4226049.

Aux 2015

Found the needle

4226049.

PiT-FT 2015

Missed

: 6036037 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 3740840.<|endoftext|>