Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#000 · needle at 30% depth #001 · needle at 3% depth #002 · needle at 66% depth #003 · needle at 66% depth #004 · needle at 46% depth #005 · needle at 62% depth #006 · needle at 12% depth #007 · needle at 91% depth #008 · needle at 87% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for early-increase is: 4947358.
One of the special magic numbers for sable-sparrow is: 7738624.
[… 429 lines omitted for display …]
One of the special magic numbers for wiry-diam is: 5522403.
One of the special magic numbers for slow-commitment is: 1050782.
One of the special magic numbers for hushed-populist is: 5182400.
One of the special magic numbers for unarmed-talking is: 2103585.
One of the special magic numbers for hypnotic-postage is: 3887704.
One of the special magic numbers for amuck-estate is: 5286942.
One of the special magic numbers for subdued-conga is: 9419411.
One of the special magic numbers for calm-gem is: 6988423.
One of the special magic numbers for alive-sushi is: 5993383.
One of the special magic numbers for thoughtless-rocker is: 9336696.
One of the special magic numbers for malicious-moment is: 9878299.
One of the special magic numbers for pretty-mode is: 4752739.
One of the special magic numbers for thundering-mantel is: 2092509.
One of the special magic numbers for equable-reason is: 8772007.
[… 216 lines omitted for display …]
One of the special magic numbers for depressed-contact is: 5934386.
One of the special magic numbers for earthy-truth is: 8582065.
What is the special magic number for calm-gem mentioned in the provided text?

Original prompt 15,278 tokens, 665 linesShown 20 lines around the needleNeedle at 66% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4110064Aux 20151704049Ours6988423Ours, no steer.6988423PiT-FT4110064Qwen 27B6988423

Ours

Found the needle

6988423.

Aux 2015

Found the needle

1704049.

PiT-FT 2015

Missed

: 8292072.
 The special magic number for the most popular-sugar is: 8292072.
 The special magic number for the most popular-sugar is: 8292072.
 The special magic number for the most popular-sugar is

The same 66-character fragment repeats 6 times until the token limit. Showing the first three.

ChronoGPT 2015

Missed

: 1830911.<|endoftext|>