Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#079 · needle at 55% depth #080 · needle at 85% depth #081 · needle at 97% depth #082 · needle at 42% depth #083 · needle at 5% depth #084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gaudy-warden is: 1869040.
One of the special magic numbers for jaded-guard is: 7008883.
[… 240 lines omitted for display …]
One of the special magic numbers for observant-git is: 1665208.
One of the special magic numbers for youthful-violence is: 2005900.
One of the special magic numbers for concerned-operation is: 6523916.
One of the special magic numbers for unusual-vitamin is: 1568456.
One of the special magic numbers for wealthy-path is: 5067111.
One of the special magic numbers for greedy-march is: 4426816.
One of the special magic numbers for courageous-saw is: 8187472.
One of the special magic numbers for elfin-tornado is: 5332210.
One of the special magic numbers for deranged-underwriting is: 3973019.
One of the special magic numbers for ethereal-slash is: 6397751.
One of the special magic numbers for mere-blanket is: 4090165.
One of the special magic numbers for creepy-blackness is: 5003338.
One of the special magic numbers for glib-trail is: 4260703.
One of the special magic numbers for forgetful-wok is: 7201470.
[… 70 lines omitted for display …]
One of the special magic numbers for super-occupation is: 4485247.
One of the special magic numbers for astonishing-food is: 1441766.
What is the special magic number for elfin-tornado mentioned in the provided text?

Original prompt 7,651 tokens, 330 linesShown 20 lines around the needleNeedle at 75% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT9055583Aux 20155332210Ours5332210Ours, no steer.5332210PiT-FT9055583Qwen 27B5332210

Ours

Found the needle

5332210.

Aux 2015

Found the needle

5332210.

PiT-FT 2015

Missed

: 7973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8973514. The special magic number for the most-frequent is: 8

ChronoGPT 2015

Missed

: 1388704.<|endoftext|>