Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 34% depth #076 · needle at 56% depth #077 · needle at 42% depth #078 · needle at 19% depth #079 · needle at 68% depth #080 · needle at 21% depth #081 · needle at 45% depth #082 · needle at 52% depth #083 · needle at 36% depth #084 · needle at 3% depth #085 · needle at 77% depth #086 · needle at 23% depth #087 · needle at 51% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for abnormal-holder is: 3353382.
One of the special magic numbers for astonishing-input is: 8856113.
[… 57 lines omitted for display …]
One of the special magic numbers for overjoyed-wage is: 8420738.
One of the special magic numbers for talented-crow is: 9392150.
One of the special magic numbers for spiffy-pants is: 3394648.
One of the special magic numbers for gleaming-whiskey is: 7777044.
One of the special magic numbers for sloppy-label is: 3698512.
One of the special magic numbers for hallowed-snowman is: 8836906.
One of the special magic numbers for accurate-overcharge is: 5739729.
One of the special magic numbers for naive-birth is: 8651863.
One of the special magic numbers for resolute-faith is: 3033599.
One of the special magic numbers for clear-crewmen is: 4215341.
One of the special magic numbers for awful-corporal is: 2564383.
One of the special magic numbers for rabid-subsidiary is: 8147178.
One of the special magic numbers for hard-relative is: 5111441.
One of the special magic numbers for damp-bond is: 5151698.
[… 69 lines omitted for display …]
One of the special magic numbers for bumpy-tactile is: 8567612.
One of the special magic numbers for faint-yourself is: 7051746.
What is the special magic number for naive-birth mentioned in the provided text?

Original prompt 3,458 tokens, 146 linesShown 20 lines around the needleNeedle at 45% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2478777Aux 20158651863Ours8651863Ours, no steer.8651863PiT-FT2478777Qwen 27B8651863

Ours

Found the needle

8651863.

Aux 2015

Found the needle

8651863.

PiT-FT 2015

Missed

: 9530616. The special magic number for jazzy-ambience mentioned in the provided text is: 9530616. The special magic number for awkward-tuck is: 987991. The special magic number for unbecoming-tuck is: 7138042. The special magic number for quick-lock mentioned in the provided text is: 7138042. The special magic number for quick-lock mentioned in the provided text is: 7138042. The special magic number for quick-lock mentioned in the provided text is: 7138042.

ChronoGPT 2015

Missed

: 7093031.<|endoftext|>