Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#036 · needle at 24% depth #037 · needle at 87% depth #038 · needle at 14% depth #039 · needle at 54% depth #040 · needle at 10% depth #041 · needle at 73% depth #042 · needle at 69% depth #043 · needle at 27% depth #044 · needle at 2% depth #045 · needle at 35% depth #046 · needle at 39% depth #047 · needle at 85% depth #048 · needle at 91% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for scientific-phrase is: 1050281.
One of the special magic numbers for historical-sow is: 9506130.
[… 1,944 lines omitted for display …]
One of the special magic numbers for hungry-grab-bag is: 1013451.
One of the special magic numbers for unadvised-lawsuit is: 3938992.
One of the special magic numbers for smoggy-screw-up is: 3092431.
One of the special magic numbers for judicious-junk is: 3686741.
One of the special magic numbers for optimal-vegetarian is: 8614467.
One of the special magic numbers for aberrant-cohesion is: 3687372.
One of the special magic numbers for silly-alpaca is: 9860959.
One of the special magic numbers for troubled-canvas is: 7163094.
One of the special magic numbers for guarded-stylus is: 6250603.
One of the special magic numbers for disagreeable-tell is: 7009611.
One of the special magic numbers for laughable-infection is: 4556536.
One of the special magic numbers for highfalutin-sensitive is: 2633529.
One of the special magic numbers for impartial-espalier is: 3054303.
One of the special magic numbers for ethereal-bathrobe is: 2371336.
[… 881 lines omitted for display …]
One of the special magic numbers for crowded-shame is: 7685917.
One of the special magic numbers for zealous-girlfriend is: 4689677.
What is the special magic number for troubled-canvas mentioned in the provided text?

Original prompt 65,018 tokens, 2,845 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8829384Aux 20158012947Ours7163094Ours, no steer.7163094PiT-FT8829384Qwen 27B7163094

Ours

Found the needle

7163094.

Aux 2015

Found the needle

8012947.

PiT-FT 2015

Missed

: 8692071. The special magic number for obnoxious-turdle is: 9851456. The special magic number for sluggish-sauce is: 7854427. The special magic number for voracious-sorch is: 7854427. The special magic number for icky-sorch is: 7854427. The special magic number for gassy-giraffe is: 7226083. The special magic number for loutish-carnival is: 7226083. The special magic number for sluggish-

ChronoGPT 2015

Missed

: Ricky-Lux: The special magic number for rambunctious-rink is: Ricky-Lux: The special magic number for rambunctious-nose is: Ricky-Lux: The special magic number for rambunctious-nose is: Ricky-Lux: The special magic number for rambunctious-nose is: Ricky-Lux: The special magic number for rambunctious-nose is: Ricky-Lux: The special magic number for rambunctious