Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#010 · needle at 60% depth #011 · needle at 86% depth #012 · needle at 24% depth #013 · needle at 58% depth #014 · needle at 60% depth #015 · needle at 6% depth #016 · needle at 56% depth #017 · needle at 48% depth #018 · needle at 34% depth #019 · needle at 88% depth #020 · needle at 50% depth #021 · needle at 65% depth #022 · needle at 29% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ugliest-cot is: 8267065.
One of the special magic numbers for womanly-middleman is: 5207244.
[… 178 lines omitted for display …]
One of the special magic numbers for abnormal-appointment is: 2507449.
One of the special magic numbers for real-pond is: 5106198.
One of the special magic numbers for muddled-salary is: 5402179.
One of the special magic numbers for possessive-leg is: 3686884.
One of the special magic numbers for excellent-divider is: 8770973.
One of the special magic numbers for jobless-reminder is: 1406434.
One of the special magic numbers for ripe-pinafore is: 3769232.
One of the special magic numbers for agreeable-urn is: 4855388.
One of the special magic numbers for pastoral-gown is: 7778420.
One of the special magic numbers for ratty-membership is: 2461159.
One of the special magic numbers for unable-recliner is: 8650871.
One of the special magic numbers for dynamic-storyboard is: 4031059.
One of the special magic numbers for juvenile-alley is: 9054398.
One of the special magic numbers for overrated-dealing is: 6382950.
[… 132 lines omitted for display …]
One of the special magic numbers for longing-maximum is: 3161029.
One of the special magic numbers for absurd-cliff is: 4248973.
What is the special magic number for agreeable-urn mentioned in the provided text?

Original prompt 7,663 tokens, 330 linesShown 20 lines around the needleNeedle at 56% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4732002Aux 20154855388Ours4855388Ours, no steer.4855388PiT-FT4732002Qwen 27B4855388

Ours

Found the needle

4855388.

Aux 2015

Found the needle

4855388.

PiT-FT 2015

Missed

: 9866499 <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

ChronoGPT 2015

Missed

: 1389216.<|endoftext|>