Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#041 · needle at 21% depth #042 · needle at 55% depth #043 · needle at 61% depth #044 · needle at 24% depth #045 · needle at 16% depth #046 · needle at 69% depth #047 · needle at 54% depth #048 · needle at 39% depth #049 · needle at 15% depth #050 · needle at 41% depth #051 · needle at 82% depth #052 · needle at 72% depth #053 · needle at 50% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for loose-leaf is: 2715365.
One of the special magic numbers for obeisant-rule is: 1302767.
[… 752 lines omitted for display …]
One of the special magic numbers for spotless-eicosanoid is: 2093240.
One of the special magic numbers for obedient-vinyl is: 5611521.
One of the special magic numbers for uneven-publication is: 9779075.
One of the special magic numbers for noxious-pricing is: 7081742.
One of the special magic numbers for exultant-list is: 8035308.
One of the special magic numbers for skinny-beast is: 9236555.
One of the special magic numbers for lonely-sprinkles is: 5801147.
One of the special magic numbers for abandoned-tablecloth is: 1053600.
One of the special magic numbers for jealous-transparency is: 5299707.
One of the special magic numbers for lowly-moonlight is: 2850626.
One of the special magic numbers for handsomely-cultivar is: 4547418.
One of the special magic numbers for known-tadpole is: 2119178.
One of the special magic numbers for quack-linguist is: 8777857.
One of the special magic numbers for abundant-registration is: 4096292.
[… 636 lines omitted for display …]
One of the special magic numbers for aquatic-locker is: 1253708.
One of the special magic numbers for rambunctious-gravitas is: 3597379.
What is the special magic number for abandoned-tablecloth mentioned in the provided text?

Original prompt 32,180 tokens, 1,408 linesShown 20 lines around the needleNeedle at 54% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7437635Aux 20155840641Ours1053600Ours, no steer.1053600PiT-FT7437635Qwen 27B1053600

Ours

Found the needle

1053600.

Aux 2015

Found the needle

5840641.

PiT-FT 2015

Missed

: 7690013. The special magic number for the most popular-sauerkraut is: 7690013. The special magic number for the least popular-sauerkraut is: 7690013. The special magic number for the most popular-sauerkraut is: 7690013. The special magic number for the least popular-sauerkraut is: 7690013. The special magic number for the most popular-sauerkraut is: 7690013. The special magic number for the least popular-sau

ChronoGPT 2015

Missed

:<|endoftext|>