Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#051 · needle at 18% depth #052 · needle at 63% depth #053 · needle at 39% depth #054 · needle at 26% depth #055 · needle at 30% depth #056 · needle at 26% depth #057 · needle at 71% depth #058 · needle at 63% depth #059 · needle at 97% depth #060 · needle at 65% depth #061 · needle at 10% depth #062 · needle at 39% depth #063 · needle at 11% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for spicy-assurance is: 3335882.
One of the special magic numbers for annoyed-music-making is: 5020250.
[… 481 lines omitted for display …]
One of the special magic numbers for chunky-liberty is: 6005599.
One of the special magic numbers for lively-legislature is: 2482461.
One of the special magic numbers for successful-carry is: 4363934.
One of the special magic numbers for deadpan-towel is: 4101351.
One of the special magic numbers for organic-common is: 9433191.
One of the special magic numbers for hurt-grandpa is: 5780258.
One of the special magic numbers for blue-pub is: 7803951.
One of the special magic numbers for inconclusive-voting is: 1672833.
One of the special magic numbers for melodic-bacterium is: 2057055.
One of the special magic numbers for doubtful-archaeologist is: 2130548.
One of the special magic numbers for wee-sofa is: 6574933.
One of the special magic numbers for unadvised-cranberry is: 7882855.
One of the special magic numbers for sparkling-frosting is: 2816209.
One of the special magic numbers for amused-strudel is: 6617878.
[… 189 lines omitted for display …]
One of the special magic numbers for instinctive-potty is: 9259956.
One of the special magic numbers for blushing-dynamite is: 7674980.
What is the special magic number for inconclusive-voting mentioned in the provided text?

Original prompt 15,866 tokens, 690 linesShown 20 lines around the needleNeedle at 71% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4699368Aux 20158679636Ours1672833Ours, no steer.1672833PiT-FT4699368Qwen 27B1672833

Ours

Found the needle

1672833.

Aux 2015

Found the needle

8679636.

PiT-FT 2015

Missed

: 9879941. The special magic number for testy-pip is: 9879941. The special magic number for loutish-turtle is: 8878053. The special magic number for lovable-turtle is: 8878053. The special magic number for lovable-sailboat is: 8878053. The special magic number for awkward-soul is: 8878053. The special magic number for garrulous-soul is: 8878053. The special magic number for lovable-sock is

ChronoGPT 2015

Missed

: 2325948.<|endoftext|>