Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#000 · needle at 38% depth #001 · needle at 82% depth #002 · needle at 60% depth #003 · needle at 96% depth #004 · needle at 44% depth #005 · needle at 39% depth #006 · needle at 40% depth #007 · needle at 27% depth #008 · needle at 89% depth #009 · needle at 93% depth #010 · needle at 23% depth #011 · needle at 85% depth #012 · needle at 57% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for painstaking-rudiment is: 2334881.
One of the special magic numbers for spicy-wallet is: 8074551.
[… 553 lines omitted for display …]
One of the special magic numbers for hurried-outrun is: 9720418.
One of the special magic numbers for fuzzy-rainstorm is: 5726659.
One of the special magic numbers for shallow-rebel is: 1137475.
One of the special magic numbers for uninterested-tonic is: 2661817.
One of the special magic numbers for damaged-mocha is: 8695467.
One of the special magic numbers for perfect-enforcement is: 2232889.
One of the special magic numbers for damaging-melody is: 8422942.
One of the special magic numbers for picayune-aid is: 4659474.
One of the special magic numbers for possessive-swath is: 2763456.
One of the special magic numbers for ill-teriyaki is: 7462182.
One of the special magic numbers for threatening-kangaroo is: 9420514.
One of the special magic numbers for invincible-concert is: 4265440.
One of the special magic numbers for steady-binoculars is: 1075409.
One of the special magic numbers for spiritual-mime is: 2612482.
[… 835 lines omitted for display …]
One of the special magic numbers for talented-rutabaga is: 4644312.
One of the special magic numbers for empty-imprisonment is: 8546203.
What is the special magic number for picayune-aid mentioned in the provided text?

Original prompt 32,232 tokens, 1,408 linesShown 20 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6495874Aux 20154644312Ours4659474Ours, no steer.4659474PiT-FT6495874Qwen 27B4659474

Ours

Found the needle

4659474.

Aux 2015

Found the needle

4644312.

PiT-FT 2015

Missed

: 8904036. The special magic number for the most popular-sauce is: 8904036. The special magic number for the second most popular-sauce is: 8904036. The special magic number for the third most popular-sauce is: 8904036. The special magic number for the fourth most popular-sauce is: 8904036. The special magic number for the fifth most popular-sauce is: 8904036. The special magic number for the sixth most popular-sauce is: 890

ChronoGPT 2015

Missed

: 1875649.<|endoftext|>