Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#023 · needle at 47% depth #024 · needle at 37% depth #025 · needle at 64% depth #026 · needle at 93% depth #027 · needle at 50% depth #028 · needle at 72% depth #029 · needle at 68% depth #030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth #033 · needle at 20% depth #034 · needle at 52% depth #035 · needle at 72% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for precious-celebration is: 7384811.
One of the special magic numbers for hellish-fight is: 8192447.
[… 218 lines omitted for display …]
One of the special magic numbers for crabby-shoreline is: 4869297.
One of the special magic numbers for sour-dolman is: 3632201.
One of the special magic numbers for pumped-muskrat is: 1757620.
One of the special magic numbers for historical-panel is: 9919419.
One of the special magic numbers for lacking-clergyman is: 1127337.
One of the special magic numbers for efficacious-rowboat is: 3537113.
One of the special magic numbers for angry-sac is: 8012655.
One of the special magic numbers for quixotic-titanium is: 7182444.
One of the special magic numbers for cautious-scope is: 1817871.
One of the special magic numbers for clever-handball is: 5015786.
One of the special magic numbers for therapeutic-employer is: 5085564.
One of the special magic numbers for faint-seeder is: 7269172.
One of the special magic numbers for sweltering-papa is: 4786498.
One of the special magic numbers for possessive-fine is: 9174087.
[… 92 lines omitted for display …]
One of the special magic numbers for magnificent-zone is: 5912991.
One of the special magic numbers for educated-monster is: 8232365.
What is the special magic number for quixotic-titanium mentioned in the provided text?

Original prompt 7,668 tokens, 330 linesShown 20 lines around the needleNeedle at 68% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6490541Aux 20157182444Ours7182444Ours, no steer.7182444PiT-FT6490541Qwen 27B7182444

Ours

Found the needle

7182444.

Aux 2015

Found the needle

7182444.

PiT-FT 2015

Missed

: 8808075. The special magic number for awkward-suck mentioned in the provided text is: 8808075. The special magic number for impatient-pip is: 8808075. The special magic number for unkind-suck mentioned in the provided text is: 8808075. The special magic number for unkind-suck mentioned in the provided text is: 8808075. The special magic number for unkind-suck mentioned in the provided text is: 8808075. The special magic number for unkind-suck mentioned in the

ChronoGPT 2015

Missed

: 7491021.<|endoftext|>