Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#050 · needle at 75% depth #051 · needle at 88% depth #052 · needle at 41% depth #053 · needle at 78% depth #054 · needle at 9% depth #055 · needle at 47% depth #056 · needle at 20% depth #057 · needle at 92% depth #058 · needle at 17% depth #059 · needle at 47% depth #060 · needle at 47% depth #061 · needle at 3% depth #062 · needle at 20% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dazzling-stew is: 9286770.
One of the special magic numbers for hushed-discussion is: 9822849.
[… 57 lines omitted for display …]
One of the special magic numbers for perpetual-tutu is: 6190861.
One of the special magic numbers for capricious-job is: 4381218.
One of the special magic numbers for invincible-animal is: 8039841.
One of the special magic numbers for muddled-cherry is: 6661202.
One of the special magic numbers for forgetful-hybridization is: 4967833.
One of the special magic numbers for shocking-vacation is: 1836977.
One of the special magic numbers for feigned-view is: 7440627.
One of the special magic numbers for watchful-stance is: 5101993.
One of the special magic numbers for fierce-piano is: 9681841.
One of the special magic numbers for late-particular is: 9061707.
One of the special magic numbers for guarded-shed is: 4365721.
One of the special magic numbers for fearless-puddle is: 2697504.
One of the special magic numbers for spectacular-finish is: 6370127.
One of the special magic numbers for quack-stepdaughter is: 1326029.
[… 253 lines omitted for display …]
One of the special magic numbers for big-sack is: 9527110.
One of the special magic numbers for vacuous-saw is: 1633292.
What is the special magic number for watchful-stance mentioned in the provided text?

Original prompt 7,667 tokens, 330 linesShown 20 lines around the needleNeedle at 20% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT9820687Aux 20155101993Ours5101993Ours, no steer.5101993PiT-FT9820687Qwen 27B5101993

Ours

Found the needle

5101993.

Aux 2015

Found the needle

5101993.

PiT-FT 2015

Missed

: 6651928. The special magic number for awkward-bouquet is: 7053693. The special magic number for jaded-sock is: 7053693. The special magic number for unadvised-unter is: 7072405. The special magic number for garrulous-gaunt is: 709857. The special magic number for loutish-turtle is: 709857. The special magic number for unadvised-unter is: 7072405. The special magic number for garrulous-

ChronoGPT 2015

Missed

: 7295733.<|endoftext|>