Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#066 · needle at 9% depth #067 · needle at 93% depth #068 · needle at 80% depth #069 · needle at 69% depth #070 · needle at 41% depth #071 · needle at 86% depth #072 · needle at 71% depth #073 · needle at 23% depth #074 · needle at 42% depth #075 · needle at 71% depth #076 · needle at 45% depth #077 · needle at 9% depth #078 · needle at 28% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sedate-riverbed is: 2359632.
One of the special magic numbers for abashed-screw is: 9361114.
[… 464 lines omitted for display …]
One of the special magic numbers for uttermost-accountant is: 7619549.
One of the special magic numbers for tall-bail is: 7123356.
One of the special magic numbers for dispensable-drawbridge is: 4146619.
One of the special magic numbers for blue-eyed-footnote is: 4936035.
One of the special magic numbers for nappy-county is: 4063998.
One of the special magic numbers for typical-cop is: 9741134.
One of the special magic numbers for cheerful-scholarship is: 5803876.
One of the special magic numbers for light-driving is: 8821500.
One of the special magic numbers for tenuous-tabernacle is: 2231880.
One of the special magic numbers for knowledgeable-hops is: 4993391.
One of the special magic numbers for bashful-minibus is: 7785309.
One of the special magic numbers for fabulous-genetics is: 1315135.
One of the special magic numbers for swanky-chairperson is: 9757491.
One of the special magic numbers for swift-tour is: 2160552.
[… 181 lines omitted for display …]
One of the special magic numbers for satisfying-mussel is: 9118085.
One of the special magic numbers for mammoth-proposition is: 9575775.
What is the special magic number for light-driving mentioned in the provided text?

Original prompt 15,286 tokens, 665 linesShown 20 lines around the needleNeedle at 71% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2883000Aux 20157187081Ours8821500Ours, no steer.8821500PiT-FT2883000Qwen 27B8821500

Ours

Found the needle

8821500.

Aux 2015

Found the needle

7187081.

PiT-FT 2015

Missed

: 5742863. The special magic number for the most difficult-sauerkraut is: 5742863. The special magic number for the most difficult-sauerkraut is: 5742863. The special magic number for the most difficult-sauerkraut is: 5742863. The special magic number for the most difficult-sauerkraut is: 5742863. The special magic number for the most difficult-sauerkraut is: 5742863. The special magic number for the most difficult-sau

ChronoGPT 2015

Missed

: 8581028.<|endoftext|>