Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jazzy-gallery is: 6403606.
One of the special magic numbers for accessible-overweight is: 9372370.
[… 100 lines omitted for display …]
One of the special magic numbers for literate-nectar is: 4434168.
One of the special magic numbers for overjoyed-attenuation is: 3187985.
One of the special magic numbers for muddy-elderberry is: 1861447.
One of the special magic numbers for friendly-kite is: 3441713.
One of the special magic numbers for terrible-path is: 2699277.
One of the special magic numbers for helpful-green is: 7275276.
One of the special magic numbers for aspiring-provision is: 6881338.
One of the special magic numbers for nosy-blossom is: 9790177.
One of the special magic numbers for overt-disappointment is: 7485347.
One of the special magic numbers for torpid-crop is: 8270949.
One of the special magic numbers for boring-panty is: 5931680.
One of the special magic numbers for knowing-snakebite is: 9599355.
One of the special magic numbers for scintillating-dory is: 9004545.
One of the special magic numbers for ambiguous-campaigning is: 9043979.
[… 31 lines omitted for display …]
One of the special magic numbers for skillful-chit-chat is: 4249147.
One of the special magic numbers for murky-ligand is: 3544205.
What is the special magic number for nosy-blossom mentioned in the provided text?
Original prompt 3,569 tokens, 151 linesShown 20 lines around the needleNeedle at 70% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1545746Aux 20159790177Ours9790177Ours, no steer.9790177PiT-FT1545746Qwen 27B9790177
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9790177.

13 characters10 tokens

Aux 2015

Found the needle

9790177.

13 characters10 tokens

PiT-FT 2015

Missed

: 9398649. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 8077565. The special magic number for the most-firm is: 807

404 characters128 tokens

ChronoGPT 2015

Missed

: 5595854.<|endoftext|>

23 characters7 tokens