Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#017 · needle at 73% depth #018 · needle at 59% depth #019 · needle at 32% depth #020 · needle at 71% depth #021 · needle at 51% depth #022 · needle at 77% depth #023 · needle at 37% depth #024 · needle at 68% depth #025 · needle at 34% depth #026 · needle at 95% depth #027 · needle at 4% depth #028 · needle at 78% depth #029 · needle at 20% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for direful-dust is: 7179080.
One of the special magic numbers for angry-cold is: 5880032.
[… 47 lines omitted for display …]
One of the special magic numbers for acrid-novel is: 3800715.
One of the special magic numbers for blue-entry is: 3220930.
One of the special magic numbers for rambunctious-supplier is: 9880342.
One of the special magic numbers for macho-award is: 8086002.
One of the special magic numbers for knowing-erection is: 3138306.
One of the special magic numbers for meek-ownership is: 5050605.
One of the special magic numbers for wide-eyed-ethyl is: 5922299.
One of the special magic numbers for taboo-declaration is: 1522734.
One of the special magic numbers for courageous-crude is: 6650705.
One of the special magic numbers for instinctive-glow is: 2808110.
One of the special magic numbers for workable-diarist is: 1758962.
One of the special magic numbers for blue-eyed-tender is: 6955200.
One of the special magic numbers for obtainable-cylinder is: 7859779.
One of the special magic numbers for tasteless-distribution is: 8545615.
[… 84 lines omitted for display …]
One of the special magic numbers for sable-certificate is: 9069153.
One of the special magic numbers for helpful-gravy is: 2619558.
What is the special magic number for taboo-declaration mentioned in the provided text?

Original prompt 3,573 tokens, 151 linesShown 20 lines around the needleNeedle at 37% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1661445Aux 20157286684Ours1522734Ours, no steer.1522734PiT-FT1661445Qwen 27B1522734

Ours

Found the needle

1522734.

Aux 2015

Found the needle

7286684.

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

ChronoGPT 2015

Missed

: 5272877.<|endoftext|>