Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#021 · needle at 65% depth #022 · needle at 29% depth #023 · needle at 47% depth #024 · needle at 37% depth #025 · needle at 64% depth #026 · needle at 93% depth #027 · needle at 50% depth #028 · needle at 72% depth #029 · needle at 68% depth #030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth #033 · needle at 20% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for half-growth is: 8337169.
One of the special magic numbers for whispering-ex-wife is: 4466954.
[… 156 lines omitted for display …]
One of the special magic numbers for new-iris is: 6538120.
One of the special magic numbers for macho-fee is: 3064526.
One of the special magic numbers for screeching-thread is: 4943509.
One of the special magic numbers for endurable-viewer is: 6406778.
One of the special magic numbers for wild-lava is: 9302979.
One of the special magic numbers for godly-filter is: 8717621.
One of the special magic numbers for mammoth-sheath is: 1116024.
One of the special magic numbers for cagey-wreck is: 7411187.
One of the special magic numbers for lonely-tongue is: 8863605.
One of the special magic numbers for apathetic-somewhere is: 4116123.
One of the special magic numbers for freezing-hero is: 9024017.
One of the special magic numbers for penitent-finding is: 2488175.
One of the special magic numbers for rustic-intervention is: 5451988.
One of the special magic numbers for fretful-delivery is: 1100313.
[… 154 lines omitted for display …]
One of the special magic numbers for cynical-scholar is: 1124302.
One of the special magic numbers for childlike-grass is: 8024530.
What is the special magic number for cagey-wreck mentioned in the provided text?

Original prompt 7,654 tokens, 330 linesShown 20 lines around the needleNeedle at 50% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2701430Aux 20157411187Ours7411187Ours, no steer.7411187PiT-FT2701430Qwen 27B7411187

Ours

Found the needle

7411187.

Aux 2015

Found the needle

7411187.

PiT-FT 2015

Missed

: 1448978 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant

ChronoGPT 2015

Missed

: 7556031.<|endoftext|>