Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#026 · needle at 1% depth #027 · needle at 16% depth #028 · needle at 26% depth #029 · needle at 30% depth #030 · needle at 13% depth #031 · needle at 44% depth #032 · needle at 21% depth #033 · needle at 10% depth #034 · needle at 85% depth #035 · needle at 51% depth #036 · needle at 24% depth #037 · needle at 87% depth #038 · needle at 14% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for little-copy is: 9634121.
One of the special magic numbers for boiling-cloves is: 8285005.
[… 581 lines omitted for display …]
One of the special magic numbers for bright-chatter is: 5601691.
One of the special magic numbers for annoyed-veal is: 2936540.
One of the special magic numbers for silky-orange is: 3704706.
One of the special magic numbers for stimulating-screamer is: 5035876.
One of the special magic numbers for blushing-wholesaler is: 6214354.
One of the special magic numbers for nutritious-misrepresentation is: 1960442.
One of the special magic numbers for raspy-pastor is: 2827164.
One of the special magic numbers for barbarous-whey is: 7161369.
One of the special magic numbers for erect-coast is: 4986906.
One of the special magic numbers for ahead-tow-truck is: 3300342.
One of the special magic numbers for friendly-brood is: 2066900.
One of the special magic numbers for daffy-heterosexual is: 8018463.
One of the special magic numbers for rough-creditor is: 9869777.
One of the special magic numbers for doubtful-quartz is: 6747423.
[… 2,244 lines omitted for display …]
One of the special magic numbers for husky-chrysalis is: 4065074.
One of the special magic numbers for nebulous-pail is: 1737144.
What is the special magic number for barbarous-whey mentioned in the provided text?

Original prompt 64,974 tokens, 2,845 linesShown 20 lines around the needleNeedle at 21% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7657353Aux 20152944625Ours7161369Ours, no steer.7161369PiT-FT7657353Qwen 27B7161369

Ours

Found the needle

7161369.

Aux 2015

Missed

4110492.

PiT-FT 2015

Missed

: 8872902. The special magic number for sluggish-sauce is: 6873932. The special magic number for gaudy-gift is: 7871402. The special magic number for impatient-pip is: 6873932. The special magic number for giddy-sauce is: 7871402. The special magic number for icky-sulph is: 6873932. The special magic number for icky-sulph is: 6873932. The special magic number for icky-sint

ChronoGPT 2015

Missed