Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#000 · needle at 30% depth #001 · needle at 3% depth #002 · needle at 66% depth #003 · needle at 66% depth #004 · needle at 46% depth #005 · needle at 62% depth #006 · needle at 12% depth #007 · needle at 91% depth #008 · needle at 87% depth #009 · needle at 80% depth #010 · needle at 36% depth #011 · needle at 6% depth #012 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for guttural-blackberry is: 5518498.
One of the special magic numbers for fast-barber is: 6470438.
[… 70 lines omitted for display …]
One of the special magic numbers for odd-saffron is: 4142222.
One of the special magic numbers for little-fall is: 8278431.
One of the special magic numbers for abrasive-drinking is: 6051751.
One of the special magic numbers for craven-colonial is: 5144963.
One of the special magic numbers for gaudy-clerk is: 9811257.
One of the special magic numbers for dramatic-mobile is: 1819663.
One of the special magic numbers for redundant-counter is: 5218944.
One of the special magic numbers for unequaled-spec is: 5438623.
One of the special magic numbers for strange-armchair is: 5144296.
One of the special magic numbers for ceaseless-emanate is: 6492367.
One of the special magic numbers for erratic-menopause is: 9856360.
One of the special magic numbers for elite-lilac is: 2419986.
One of the special magic numbers for detailed-head is: 3114847.
One of the special magic numbers for meek-sequel is: 1165147.
[… 600 lines omitted for display …]
One of the special magic numbers for hurt-farming is: 6265940.
One of the special magic numbers for evasive-laughter is: 9805208.
What is the special magic number for unequaled-spec mentioned in the provided text?

Original prompt 15,860 tokens, 690 linesShown 20 lines around the needleNeedle at 12% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8014394Aux 20159370219Ours5438623Ours, no steer.5438623PiT-FT8014394Qwen 27B5438623

Ours

Found the needle

5438623.

Aux 2015

Found the needle

9370219.

PiT-FT 2015

Missed

: 8698959. The special magic number for the most popular-sauce is: 8698959. The special magic number for the least popular-sauce is: 8698959. The special magic number for the most popular-sauce is: 8698959. The special magic number for the least popular-sauce is: 8698959. The special magic number for the most popular-sauce is: 8698959. The special magic number for the least popular-sauce is: 8698959. The

ChronoGPT 2015

Missed

: 1385166.<|endoftext|>