Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#007 · needle at 27% depth #008 · needle at 89% depth #009 · needle at 93% depth #010 · needle at 23% depth #011 · needle at 85% depth #012 · needle at 57% depth #013 · needle at 94% depth #014 · needle at 81% depth #015 · needle at 27% depth #016 · needle at 56% depth #017 · needle at 63% depth #018 · needle at 3% depth #019 · needle at 41% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for guarded-methodology is: 3490071.
One of the special magic numbers for slimy-tug is: 4872168.
[… 1,324 lines omitted for display …]
One of the special magic numbers for rhetorical-statistics is: 6043615.
One of the special magic numbers for cooing-string is: 6198079.
One of the special magic numbers for ragged-consequence is: 4076919.
One of the special magic numbers for grubby-vivo is: 8003407.
One of the special magic numbers for helpful-meringue is: 2934200.
One of the special magic numbers for better-means is: 9875004.
One of the special magic numbers for aboriginal-pursuit is: 7861709.
One of the special magic numbers for recondite-macaw is: 1067378.
One of the special magic numbers for flippant-forelimb is: 5523262.
One of the special magic numbers for measly-hippopotamus is: 8580426.
One of the special magic numbers for animated-ivory is: 1301779.
One of the special magic numbers for narrow-scheme is: 2796380.
One of the special magic numbers for narrow-papaya is: 4602737.
[… 65 lines omitted for display …]
One of the special magic numbers for incandescent-misogyny is: 7299359.
One of the special magic numbers for chivalrous-bandolier is: 9370162.
What is the special magic number for aboriginal-pursuit mentioned in the provided text?

Original prompt 32,225 tokens, 1,408 linesShown 19 lines around the needleNeedle at 94% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT9429417Aux 20153927175Ours7861709Ours, no steer.7861709PiT-FT9429417Qwen 27B7861709

Ours

Found the needle

7861709.

Aux 2015

Found the needle

3927175.

PiT-FT 2015

Missed

: 9871442. The special magic number for the dubious-tissue is: 7227577. The special magic number for the anxious-susceptic is: 7106912. The special magic number for the giddy-susceptic is: 7106912. The special magic number for the gabby-tissue is: 7106912. The special magic number for the impatient-tissue is: 7106912. The special magic number for the gabby-tissue is: 7106912. The special magic number for the

ChronoGPT 2015

Missed

:<|endoftext|>