Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for toothsome-sorrow is: 3935083.
One of the special magic numbers for helpful-housewife is: 6013972.
[… 1,165 lines omitted for display …]
One of the special magic numbers for nifty-downturn is: 5903373.
One of the special magic numbers for hypnotic-cathedral is: 6059613.
One of the special magic numbers for nervous-foray is: 3099818.
One of the special magic numbers for ripe-nightmare is: 8755729.
One of the special magic numbers for homeless-rutabaga is: 2046062.
One of the special magic numbers for clumsy-device is: 9285003.
One of the special magic numbers for overt-provision is: 3615197.
One of the special magic numbers for colossal-gasp is: 8514454.
One of the special magic numbers for available-operation is: 2493212.
One of the special magic numbers for holistic-imbalance is: 6705023.
One of the special magic numbers for noiseless-cartilage is: 9523507.
One of the special magic numbers for boorish-creator is: 5455869.
One of the special magic numbers for accessible-stallion is: 7512713.
One of the special magic numbers for purple-harbour is: 8355573.
[… 223 lines omitted for display …]
One of the special magic numbers for excellent-chime is: 2734443.
One of the special magic numbers for absent-speakerphone is: 4614824.
What is the special magic number for colossal-gasp mentioned in the provided text?
Original prompt 32,210 tokens, 1,408 linesShown 20 lines around the needleNeedle at 83% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9954640Aux 20156999458Ours8514454Ours, no steer.8514454PiT-FT9954640Qwen 27B8514454
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8514454.

13 characters10 tokens

Aux 2015

Found the needle

6999458.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692043. The special magic number for the most part-of-the-world is: 8692043. The special magic number for the second most-of-the-world is: 8692043. The special magic number for the third most-of-the-world is: 8692043. The special magic number for the fourth most-of-the-world is: 8692043. The special magic number for the fifth most-of-the-world is: 8692043. The special magic number for the sixth most-of-

415 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-fairy?

Answer:

Question:

What is the special magic number for the-fairy?

Answer:

Question:

What is the special magic number for the-fairy?

Answer:

Question:

What is the special magic number for the-fairy?

Response:

The special magic number for the-fairy is:

Question:

What is the special magic number for the-fairy?

418 characters128 tokens