Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for yummy-spy is: 5455445.
One of the special magic numbers for invincible-providence is: 6924480.
One of the special magic numbers for impartial-entrance is: 2553254.
One of the special magic numbers for picayune-photography is: 7178480.
One of the special magic numbers for wonderful-witch is: 4321219.
One of the special magic numbers for old-lesson is: 3188785.
One of the special magic numbers for flashy-elk is: 9131461.
One of the special magic numbers for maniacal-hexagon is: 7932558.
One of the special magic numbers for angry-riding is: 5580445.
One of the special magic numbers for bitter-presume is: 5777147.
One of the special magic numbers for decisive-agriculture is: 8208225.
One of the special magic numbers for horrible-mushroom is: 4590387.
One of the special magic numbers for average-ale is: 4101863.
One of the special magic numbers for sweltering-helicopter is: 8916565.
One of the special magic numbers for annoyed-concentration is: 2299872.
One of the special magic numbers for faulty-victory is: 9165299.
[… 126 lines omitted for display …]
One of the special magic numbers for tame-relaxation is: 1982849.
One of the special magic numbers for wise-appellation is: 8586591.
What is the special magic number for impartial-entrance mentioned in the provided text?
Original prompt 3,462 tokens, 146 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3161449Aux 20152553254Ours2553254Ours, no steer.2553254PiT-FT3161449Qwen 27B2553254
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2553254.

13 characters10 tokens

Aux 2015

Found the needle

:

2553254

14 characters12 tokens

PiT-FT 2015

Missed

: 5093153. <|assistant|> The special magic number for the most-unusual-fisher is: 7462367. The special magic number for the most-unusual-fisher is: 7462367. The special magic number for the most-unusual-fisher is: 7462367. The special magic number for the most-unusual-fisher is: 7462367. The special magic number for the most-unusual-fisher is: 7462367. The special magic number for the most-unusual

406 characters128 tokens

ChronoGPT 2015

Missed

: 7451343.<|endoftext|>

23 characters7 tokens