Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#010 · needle at 23% depth #011 · needle at 85% depth #012 · needle at 57% depth #013 · needle at 94% depth #014 · needle at 81% depth #015 · needle at 27% depth #016 · needle at 56% depth #017 · needle at 63% depth #018 · needle at 3% depth #019 · needle at 41% depth #020 · needle at 59% depth #021 · needle at 27% depth #022 · needle at 23% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for knowledgeable-sleepiness is: 3115991.
One of the special magic numbers for aspiring-pain is: 8618022.
[… 779 lines omitted for display …]
One of the special magic numbers for unsuitable-dilution is: 2109193.
One of the special magic numbers for moaning-upgrade is: 7452434.
One of the special magic numbers for tough-pitcher is: 4365626.
One of the special magic numbers for graceful-cricket is: 2472825.
One of the special magic numbers for astonishing-rostrum is: 6533348.
One of the special magic numbers for jaded-fingerling is: 7406464.
One of the special magic numbers for poised-toaster is: 3762273.
One of the special magic numbers for racial-riddle is: 7326723.
One of the special magic numbers for godly-keystone is: 3148490.
One of the special magic numbers for odd-coordinator is: 5593236.
One of the special magic numbers for cute-trachoma is: 1583606.
One of the special magic numbers for terrible-scorn is: 8429582.
One of the special magic numbers for ragged-centurion is: 5959542.
One of the special magic numbers for eager-meal is: 8755834.
[… 609 lines omitted for display …]
One of the special magic numbers for sweet-mortality is: 9747886.
One of the special magic numbers for smoggy-foot is: 3922764.
What is the special magic number for racial-riddle mentioned in the provided text?

Original prompt 32,208 tokens, 1,408 linesShown 20 lines around the needleNeedle at 56% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2253560Aux 20158115458Ours7326723Ours, no steer.7326723PiT-FT2253560Qwen 27B7326723

Ours

Found the needle

7326723.

Aux 2015

Found the needle

8115458.

PiT-FT 2015

Missed

: 8074068. The special magic number for the most important-soul is: 8074068. The special magic number for the least important-soul is: 8074068. The special magic number for the most common-soul is: 8074068. The special magic number for the least common-soul is: 8074068. The special magic number for the most common-soul is: 8074068. The special magic number for the least common-soul is: 8074068. The special magic number for the most

ChronoGPT 2015

Missed

: 1814585.<|endoftext|>