Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#065 · needle at 24% depth #066 · needle at 39% depth #067 · needle at 7% depth #068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth #071 · needle at 17% depth #072 · needle at 93% depth #073 · needle at 13% depth #074 · needle at 29% depth #075 · needle at 77% depth #076 · needle at 76% depth #077 · needle at 80% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for crabby-extension is: 9535834.
One of the special magic numbers for pastoral-enclave is: 1090089.
[… 47 lines omitted for display …]
One of the special magic numbers for willing-knight is: 9472953.
One of the special magic numbers for homely-disease is: 1140237.
One of the special magic numbers for absurd-income is: 1084676.
One of the special magic numbers for abrupt-quote is: 2841134.
One of the special magic numbers for faint-tailor is: 8442363.
One of the special magic numbers for glossy-hatchet is: 4210570.
One of the special magic numbers for observant-everything is: 9566103.
One of the special magic numbers for blue-eyed-cello is: 2296999.
One of the special magic numbers for green-intervenor is: 9205804.
One of the special magic numbers for youthful-workbench is: 2637806.
One of the special magic numbers for absurd-expert is: 8964187.
One of the special magic numbers for fragile-clan is: 9516793.
One of the special magic numbers for eager-lute is: 4195678.
One of the special magic numbers for earthy-completion is: 3470780.
[… 263 lines omitted for display …]
One of the special magic numbers for quizzical-sneaker is: 8802953.
One of the special magic numbers for cooperative-throne is: 8797499.
What is the special magic number for blue-eyed-cello mentioned in the provided text?

Original prompt 7,650 tokens, 330 linesShown 20 lines around the needleNeedle at 17% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1620406Aux 20152296999Ours2296999Ours, no steer.2296999PiT-FT1620406Qwen 27B2296999

Ours

Found the needle

2296999.

Aux 2015

Found the needle

2296999.

PiT-FT 2015

Missed

: 6191397. The special magic number for the most-frequent-firm is: 8227025. The special magic number for the most-frequent-firm is: 8227025. The special magic number for the most-frequent-firm is: 8227025. The special magic number for the most-frequent-firm is: 8227025. The special magic number for the most-frequent-firm is: 8227025. The special magic number for the most-frequent-firm is: 8

ChronoGPT 2015

Missed

: 7095465.<|endoftext|>