Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#000 · needle at 81% depth #001 · needle at 85% depth #002 · needle at 44% depth #003 · needle at 63% depth #004 · needle at 73% depth #005 · needle at 55% depth #006 · needle at 84% depth #007 · needle at 11% depth #008 · needle at 30% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for glamorous-shoelace is: 3917016.
One of the special magic numbers for afraid-hydroxyl is: 7784575.
[… 58 lines omitted for display …]
One of the special magic numbers for dusty-chainstay is: 9228157.
One of the special magic numbers for alive-viewer is: 2514267.
One of the special magic numbers for auspicious-invitation is: 4902772.
One of the special magic numbers for steady-concern is: 4671004.
One of the special magic numbers for acceptable-pepperoni is: 9832340.
One of the special magic numbers for petite-credit is: 1011467.
One of the special magic numbers for inconclusive-everybody is: 4380011.
One of the special magic numbers for upbeat-nylon is: 6013715.
One of the special magic numbers for curved-grill is: 6716988.
One of the special magic numbers for wistful-scholar is: 3977282.
One of the special magic numbers for imaginary-decoration is: 1999183.
One of the special magic numbers for accurate-breadcrumb is: 3478196.
One of the special magic numbers for sour-mom is: 3376537.
One of the special magic numbers for colorful-consciousness is: 9829762.
[… 73 lines omitted for display …]
One of the special magic numbers for angry-communicant is: 5417373.
One of the special magic numbers for numberless-toilet is: 8802377.
What is the special magic number for upbeat-nylon mentioned in the provided text?

Original prompt 3,571 tokens, 151 linesShown 20 lines around the needleNeedle at 44% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3778404Aux 20159614423Ours6013715Ours, no steer.6013715PiT-FT3778404Qwen 27B6013715

Ours

Found the needle

6013715.

Aux 2015

Found the needle

9614423.

PiT-FT 2015

Missed

: 5519920.
 The special magic number for numerous-broadcast mentioned in the provided text is: 5519920.
 The special magic number for numerous-broadcast mentioned in the provided text is: 5519920.
 The special magic number for numerous-broadcast mentioned in the provided text is

The same 93-character fragment repeats 6 times until the token limit. Showing the first three.

ChronoGPT 2015

Missed

: 7291957.<|endoftext|>