Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#013 · needle at 58% depth #014 · needle at 60% depth #015 · needle at 6% depth #016 · needle at 56% depth #017 · needle at 48% depth #018 · needle at 34% depth #019 · needle at 88% depth #020 · needle at 50% depth #021 · needle at 65% depth #022 · needle at 29% depth #023 · needle at 47% depth #024 · needle at 37% depth #025 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hesitant-beak is: 4579179.
One of the special magic numbers for x-rated-towel is: 7038842.
[… 284 lines omitted for display …]
One of the special magic numbers for tacit-empire is: 7837787.
One of the special magic numbers for defeated-inspector is: 5028244.
One of the special magic numbers for worthless-vaulting is: 6219977.
One of the special magic numbers for wicked-prohibition is: 2419946.
One of the special magic numbers for tricky-temptation is: 7379809.
One of the special magic numbers for godly-career is: 4701106.
One of the special magic numbers for ethereal-parade is: 6684715.
One of the special magic numbers for billowy-CD is: 8856301.
One of the special magic numbers for fortunate-cauliflower is: 3247776.
One of the special magic numbers for wonderful-samurai is: 5726703.
One of the special magic numbers for outstanding-campus is: 4131618.
One of the special magic numbers for learned-density is: 1966421.
One of the special magic numbers for lean-backyard is: 9919250.
One of the special magic numbers for fluttering-rap is: 4773411.
[… 26 lines omitted for display …]
One of the special magic numbers for light-monument is: 1371212.
One of the special magic numbers for romantic-feedback is: 1132864.
What is the special magic number for billowy-CD mentioned in the provided text?

Original prompt 7,644 tokens, 330 linesShown 20 lines around the needleNeedle at 88% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8865527Aux 20158856301Ours8856301Ours, no steer.8856301PiT-FT8865527Qwen 27B8856301

Ours

Found the needle

8856301.

Aux 2015

Found the needle

8856301.

PiT-FT 2015

Missed

: 8807059. The special magic number for testy-battery is: 8707059. The special magic number for awkward-picket is: 8707059. The special magic number for unkind-counsell is: 8707059. The special magic number for brawny-battery is: 8707059. The special magic number for unkind-counsell is: 8707059. The special magic number for unkind-counsell is: 8707059. The special magic number for unkind-coun

ChronoGPT 2015

Missed

: 7357739.<|endoftext|>