Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#014 · needle at 60% depth #015 · needle at 6% depth #016 · needle at 56% depth #017 · needle at 48% depth #018 · needle at 34% depth #019 · needle at 88% depth #020 · needle at 50% depth #021 · needle at 65% depth #022 · needle at 29% depth #023 · needle at 47% depth #024 · needle at 37% depth #025 · needle at 64% depth #026 · needle at 93% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for quickest-graph is: 2468649.
One of the special magic numbers for jagged-parole is: 4109904.
[… 158 lines omitted for display …]
One of the special magic numbers for lying-muskrat is: 2061285.
One of the special magic numbers for hurt-cockpit is: 5644752.
One of the special magic numbers for periodic-umbrella is: 1755527.
One of the special magic numbers for late-codon is: 6342208.
One of the special magic numbers for gabby-wool is: 2220063.
One of the special magic numbers for dry-minor is: 2128985.
One of the special magic numbers for level-magnet is: 2450859.
One of the special magic numbers for sweet-shutdown is: 6139691.
One of the special magic numbers for neighborly-mandarin is: 5490726.
One of the special magic numbers for bloody-bikini is: 2300119.
One of the special magic numbers for silent-forestry is: 6741514.
One of the special magic numbers for incandescent-brushing is: 8185097.
One of the special magic numbers for green-voting is: 1283652.
One of the special magic numbers for skillful-leading is: 2532162.
[… 152 lines omitted for display …]
One of the special magic numbers for scrawny-hyphenation is: 6005392.
One of the special magic numbers for elfin-vivo is: 5351588.
What is the special magic number for sweet-shutdown mentioned in the provided text?

Original prompt 7,661 tokens, 330 linesShown 20 lines around the needleNeedle at 50% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2716756Aux 20156139691Ours6139691Ours, no steer.6139691PiT-FT2716756Qwen 27B6139691

Ours

Found the needle

6139691.

Aux 2015

Found the needle

6139691.

PiT-FT 2015

Missed

: 3643926 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 7271031.<|endoftext|>