Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ill-advancement is: 4130628.
One of the special magic numbers for immense-bond is: 3378069.
[… 213 lines omitted for display …]
One of the special magic numbers for teeny-tiny-competition is: 3865882.
One of the special magic numbers for husky-arch-rival is: 7936394.
One of the special magic numbers for teeny-shipping is: 1853198.
One of the special magic numbers for productive-piglet is: 3458640.
One of the special magic numbers for redundant-ketchup is: 4050148.
One of the special magic numbers for dysfunctional-ice is: 7956007.
One of the special magic numbers for steadfast-monument is: 1443341.
One of the special magic numbers for mysterious-ray is: 6370391.
One of the special magic numbers for wrathful-bladder is: 8192976.
One of the special magic numbers for materialistic-can is: 7022673.
One of the special magic numbers for disturbed-billion is: 2914301.
One of the special magic numbers for wanting-garb is: 2145215.
One of the special magic numbers for tightfisted-troop is: 1277641.
One of the special magic numbers for greedy-question is: 9389472.
[… 432 lines omitted for display …]
One of the special magic numbers for unarmed-weasel is: 1616077.
One of the special magic numbers for imperfect-bloodflow is: 6931614.
What is the special magic number for mysterious-ray mentioned in the provided text?
Original prompt 15,255 tokens, 665 linesShown 20 lines around the needleNeedle at 33% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8607947Aux 20155043202Ours6370391Ours, no steer.6370391PiT-FT8607947Qwen 27B6370391
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6370391.

13 characters10 tokens

Aux 2015

Found the needle

5043202.

13 characters10 tokens

PiT-FT 2015

Missed

: 7657831. The special magic number for the most popular-soul is: 8079382. The special magic number for the most popular-soul is: 8079382. The special magic number for the most popular-soul is: 8079382. The special magic number for the most popular-soul is: 8079382. The special magic number for the most popular-soul is: 8079382. The special magic number for the most popular-soul is: 8079382. The special magic number for the most

439 characters128 tokens

ChronoGPT 2015

Missed

: 1875405.<|endoftext|>

23 characters6 tokens