Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#077 · needle at 80% depth #078 · needle at 25% depth #079 · needle at 55% depth #080 · needle at 85% depth #081 · needle at 97% depth #082 · needle at 42% depth #083 · needle at 5% depth #084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for plucky-vase is: 1127165.
One of the special magic numbers for dusty-quarter is: 8877745.
[… 6 lines omitted for display …]
One of the special magic numbers for nostalgic-cable is: 4017955.
One of the special magic numbers for steep-station is: 7449845.
One of the special magic numbers for unequaled-dueling is: 7477274.
One of the special magic numbers for red-croissant is: 4041965.
One of the special magic numbers for perpetual-rainy is: 4839511.
One of the special magic numbers for good-toot is: 3837175.
One of the special magic numbers for redundant-mole is: 1985352.
One of the special magic numbers for lowly-okra is: 1505054.
One of the special magic numbers for torpid-nanoparticle is: 5455111.
One of the special magic numbers for doubtful-horst is: 7660850.
One of the special magic numbers for rustic-nut is: 6445791.
One of the special magic numbers for vast-schnitzel is: 5886096.
One of the special magic numbers for heady-hosiery is: 7612415.
One of the special magic numbers for abandoned-programming is: 7764881.
[… 304 lines omitted for display …]
One of the special magic numbers for assorted-guacamole is: 6376637.
One of the special magic numbers for invincible-ammunition is: 6657931.
What is the special magic number for lowly-okra mentioned in the provided text?

Original prompt 7,650 tokens, 330 linesShown 20 lines around the needleNeedle at 5% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7180048Aux 20151505054Ours1505054Ours, no steer.1505054PiT-FT7180048Qwen 27B1505054

Ours

Found the needle

1505054.

Aux 2015

Found the needle

1505054.

PiT-FT 2015

Missed

: 8563935.
 The special magic number for the most difficult-tooth is: 8563935.
 The special magic number for the most difficult-tooth is: 8563935.
 The special magic number for the most difficult-tooth is

The same 68-character fragment repeats 6 times until the token limit. Showing the first three.

ChronoGPT 2015

Missed

: 7452337.<|endoftext|>