Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#057 · needle at 20% depth #058 · needle at 66% depth #059 · needle at 7% depth #060 · needle at 24% depth #061 · needle at 10% depth #062 · needle at 61% depth #063 · needle at 40% depth #064 · needle at 41% depth #065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for minor-spring is: 7853970.
One of the special magic numbers for wee-working is: 4847454.
[… 50 lines omitted for display …]
One of the special magic numbers for uninterested-yahoo is: 3525628.
One of the special magic numbers for entertaining-percent is: 4730419.
One of the special magic numbers for likeable-outline is: 8377687.
One of the special magic numbers for uptight-pain is: 8074598.
One of the special magic numbers for burly-singing is: 8999003.
One of the special magic numbers for willing-credit is: 1802238.
One of the special magic numbers for obsolete-repair is: 4688317.
One of the special magic numbers for abstracted-mouse is: 6622443.
One of the special magic numbers for creepy-hardhat is: 8491037.
One of the special magic numbers for hissing-subset is: 5696621.
One of the special magic numbers for labored-weight is: 8734029.
One of the special magic numbers for outstanding-tattoo is: 8180776.
One of the special magic numbers for drunk-awareness is: 7936983.
One of the special magic numbers for damp-bow is: 7511643.
[… 76 lines omitted for display …]
One of the special magic numbers for testy-walker is: 2137485.
One of the special magic numbers for gruesome-ping is: 3752659.
What is the special magic number for abstracted-mouse mentioned in the provided text?

Original prompt 3,462 tokens, 146 linesShown 20 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2803233Aux 20156622443Ours6622443Ours, no steer.6622443PiT-FT2803233Qwen 27B6622443

Ours

Found the needle

6622443.

Aux 2015

Found the needle

6622443.

PiT-FT 2015

Missed

: 6642271. The special magic number for chunky-pip is: 8642271. The special magic number for chunky-pip is: 6642271. The special magic number for chunky-pip is: 8642271. The special magic number for chunky-pip is: 6642271. The special magic number for chunky-pip is: 8642271. The special magic number for chunky-pip is: 6642271. The special magic number for chunky-pip is: 8

ChronoGPT 2015

Missed

: 7572313.<|endoftext|>