Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#090 · needle at 72% depth #091 · needle at 11% depth #092 · needle at 89% depth #093 · needle at 58% depth #094 · needle at 18% depth #095 · needle at 42% depth #096 · needle at 32% depth #097 · needle at 81% depth #098 · needle at 18% depth #099 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for godly-set is: 3893723.
One of the special magic numbers for testy-gaffer is: 5789406.
[… 38 lines omitted for display …]
One of the special magic numbers for cagey-polenta is: 7364181.
One of the special magic numbers for uneven-broiler is: 6913267.
One of the special magic numbers for subdued-knee is: 2976741.
One of the special magic numbers for cool-tugboat is: 3928367.
One of the special magic numbers for slimy-veneer is: 6042011.
One of the special magic numbers for naive-chasuble is: 5409764.
One of the special magic numbers for alluring-salmon is: 5148624.
One of the special magic numbers for nonstop-dispatch is: 6137720.
One of the special magic numbers for big-ex-husband is: 2794806.
One of the special magic numbers for rustic-team is: 3612040.
One of the special magic numbers for screeching-frown is: 8753549.
One of the special magic numbers for standing-multimedia is: 2584305.
One of the special magic numbers for glossy-leveret is: 8292146.
One of the special magic numbers for labored-stepping-stone is: 6853208.
[… 88 lines omitted for display …]
One of the special magic numbers for adhesive-finger is: 9383049.
One of the special magic numbers for flipped-out-insomnia is: 1114282.
What is the special magic number for nonstop-dispatch mentioned in the provided text?

Original prompt 3,470 tokens, 146 linesShown 20 lines around the needleNeedle at 32% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1044315Aux 20156137720Ours6137720Ours, no steer.6137720PiT-FT1044315Qwen 27B6137720

Ours

Found the needle

6137720.

Aux 2015

Found the needle

6137720.

PiT-FT 2015

Missed

: 7572841.
 The special magic number for smooth-tree mentioned in the provided text is: 7572841.
 The special magic number for smooth-tree mentioned in the provided text is: 7572841.
 The special magic number for smooth-tree mentioned in the provided text is

The same 86-character fragment repeats 6 times until the token limit. Showing the first three.

ChronoGPT 2015

Missed

: 7792585.<|endoftext|>