Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for magenta-licensing is: 6418354.
One of the special magic numbers for scintillating-fedelini is: 5728628.
[… 107 lines omitted for display …]
One of the special magic numbers for feigned-lack is: 9060974.
One of the special magic numbers for hurried-gosling is: 6199969.
One of the special magic numbers for square-neurobiologist is: 4309652.
One of the special magic numbers for evanescent-spool is: 1620291.
One of the special magic numbers for obeisant-frenzy is: 9855100.
One of the special magic numbers for clammy-reason is: 2856366.
One of the special magic numbers for blue-glider is: 8421397.
One of the special magic numbers for dazzling-soprano is: 8946282.
One of the special magic numbers for clever-surgeon is: 8098844.
One of the special magic numbers for ashamed-gum is: 1612597.
One of the special magic numbers for guarded-tentacle is: 1396379.
One of the special magic numbers for doubtful-masonry is: 2557354.
One of the special magic numbers for grandiose-maybe is: 5808585.
One of the special magic numbers for heavy-employer is: 2445038.
[… 19 lines omitted for display …]
One of the special magic numbers for thundering-accounting is: 8656484.
One of the special magic numbers for fluttering-buggy is: 2740898.
What is the special magic number for dazzling-soprano mentioned in the provided text?
Original prompt 3,461 tokens, 146 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9868411Aux 20158946282Ours8946282Ours, no steer.8946282PiT-FT9868411Qwen 27B8946282
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8946282.

13 characters10 tokens

Aux 2015

Found the needle

8946282.

13 characters10 tokens

PiT-FT 2015

Missed
: 8356562.
 The special magic number for the most-firm is: 8356562.
 The special magic number for the most-firm is: 8356562.
 The special magic number for the most-firm is

The same 57-character fragment repeats 7 times until the token limit. Showing the first three.

402 characters128 tokens

ChronoGPT 2015

Missed

: 5151659.<|endoftext|>

23 characters7 tokens