Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for erratic-weather is: 7102541.
One of the special magic numbers for quixotic-albatross is: 8406711.
[… 364 lines omitted for display …]
One of the special magic numbers for unaccountable-stake is: 3831324.
One of the special magic numbers for dapper-lake is: 9172968.
One of the special magic numbers for permissible-optimisation is: 4944610.
One of the special magic numbers for woebegone-bronze is: 7008257.
One of the special magic numbers for mighty-tone is: 6044150.
One of the special magic numbers for tested-sprinter is: 5486713.
One of the special magic numbers for moaning-sparrow is: 7832865.
One of the special magic numbers for sour-gopher is: 8031860.
One of the special magic numbers for cute-referendum is: 2267612.
One of the special magic numbers for thoughtful-main is: 1282059.
One of the special magic numbers for purring-tectonics is: 3097223.
One of the special magic numbers for kind-rethinking is: 7895874.
One of the special magic numbers for grouchy-luggage is: 5990024.
[… 5,335 lines omitted for display …]
One of the special magic numbers for curly-ceramics is: 1527369.
One of the special magic numbers for outstanding-marmalade is: 4371658.
What is the special magic number for moaning-sparrow mentioned in the provided text?
Original prompt 130,399 tokens, 5,718 linesShown 19 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7152396Aux 20151086854Ours7832865Ours, no steer.7832865PiT-FT7152396Qwen 27B7832865
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7832865.

13 characters10 tokens

Aux 2015

Missed

9477454.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

: ###ettlement-cuss-battler The special Epicurean Epicurean The special Gavian-canser is: The special Gavian-canser for rambunctuet is: The special Gavian-sable Gavian-sable The special Gavian-sable Gavian-sable The special Gavian-sable Gavian-sable The special Gavian-sable Gavian- sable The special Gavian-sable Gavian- sable The special

339 characters128 tokens