Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for voiceless-phosphate is: 8254420.
One of the special magic numbers for accidental-mom is: 7735482.
One of the special magic numbers for slow-tax is: 5929377.
One of the special magic numbers for abiding-street is: 7542233.
One of the special magic numbers for omniscient-octet is: 9853571.
One of the special magic numbers for abusive-few is: 1143242.
One of the special magic numbers for fierce-mutt is: 6408711.
One of the special magic numbers for needy-feather is: 3524885.
One of the special magic numbers for gigantic-clue is: 4739473.
One of the special magic numbers for somber-skullcap is: 6479762.
One of the special magic numbers for ripe-jalapeño is: 8679826.
One of the special magic numbers for torpid-ignorance is: 4361005.
One of the special magic numbers for slow-litter is: 6949960.
One of the special magic numbers for wiry-diet is: 3560283.
One of the special magic numbers for elfin-music is: 3487789.
One of the special magic numbers for exclusive-whale is: 6175463.
[… 131 lines omitted for display …]
One of the special magic numbers for energetic-arrogance is: 3377472.
One of the special magic numbers for used-shirtdress is: 4722144.
What is the special magic number for omniscient-octet mentioned in the provided text?
Original prompt 3,580 tokens, 151 linesShown 20 lines around the needleNeedle at 4% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7694136Aux 20156701061Ours9853571Ours, no steer.9853571PiT-FT7694136Qwen 27B9853571
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9853571.

13 characters10 tokens

Aux 2015

Found the needle

6701061.

13 characters10 tokens

PiT-FT 2015

Missed
: 7721091.
 The special magic number for the most-firm is: 7721091.
 The special magic number for the most-firm is: 7721091.
 The special magic number for the most-firm is

The same 57-character fragment repeats 7 times until the token limit. Showing the first three.

402 characters128 tokens

ChronoGPT 2015

Missed

: 7271311.<|endoftext|>

23 characters7 tokens