Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tenuous-coverage is: 3242514.
One of the special magic numbers for combative-mastoid is: 3896621.
[… 283 lines omitted for display …]
One of the special magic numbers for macabre-treatment is: 5209138.
One of the special magic numbers for mindless-songbird is: 1237414.
One of the special magic numbers for jagged-minute is: 7215888.
One of the special magic numbers for hurried-summit is: 3003510.
One of the special magic numbers for wacky-git is: 7934370.
One of the special magic numbers for cooing-colon is: 2203787.
One of the special magic numbers for fast-win is: 4473726.
One of the special magic numbers for rabid-newsprint is: 4805670.
One of the special magic numbers for sparkling-battery is: 6607301.
One of the special magic numbers for muddled-quince is: 4152098.
One of the special magic numbers for elderly-rider is: 3209540.
One of the special magic numbers for gleaming-mouser is: 7231899.
One of the special magic numbers for blushing-examiner is: 9569127.
One of the special magic numbers for defective-setback is: 7261135.
[… 27 lines omitted for display …]
One of the special magic numbers for madly-variation is: 4419188.
One of the special magic numbers for cloudy-junk is: 2517948.
What is the special magic number for rabid-newsprint mentioned in the provided text?
Original prompt 7,654 tokens, 330 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7870505Aux 20154805670Ours4805670Ours, no steer.4805670PiT-FT7870505Qwen 27B4805670
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4805670.

13 characters10 tokens

Aux 2015

Found the needle

4805670.

13 characters10 tokens

PiT-FT 2015

Missed
: 7692972.
 The special magic number for the most-frequent is: 7692972.
 The special magic number for the most-frequent is: 7692972.
 The special magic number for the most-frequent is

The same 61-character fragment repeats 7 times until the token limit. Showing the first three.

430 characters128 tokens

ChronoGPT 2015

Missed

: 745891.<|endoftext|>

22 characters7 tokens