Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lavish-money is: 6937787.
One of the special magic numbers for victorious-adjective is: 7110245.
One of the special magic numbers for aquatic-accent is: 6798417.
One of the special magic numbers for cautious-property is: 2543109.
One of the special magic numbers for watery-statement is: 8826136.
One of the special magic numbers for unusual-prison is: 7323344.
One of the special magic numbers for calm-guideline is: 6047704.
One of the special magic numbers for difficult-turret is: 7479257.
One of the special magic numbers for mute-parade is: 3324487.
One of the special magic numbers for helpful-tune-up is: 6128431.
One of the special magic numbers for fine-duty is: 7910517.
One of the special magic numbers for productive-opposition is: 9010723.
One of the special magic numbers for weary-redirect is: 1052016.
One of the special magic numbers for giddy-broker is: 2506474.
One of the special magic numbers for broken-goal is: 1266266.
One of the special magic numbers for purple-alias is: 1675614.
One of the special magic numbers for aspiring-ziggurat is: 3997684.
[… 644 lines omitted for display …]
One of the special magic numbers for amused-peacoat is: 2950399.
One of the special magic numbers for gentle-frog is: 8502474.
What is the special magic number for victorious-adjective mentioned in the provided text?
Original prompt 15,301 tokens, 665 linesShown 21 lines around the needleNeedle at 0% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2035907Aux 20156119760Ours7110245Ours, no steer.7110245PiT-FT2035907Qwen 27B7110245
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7110245.

13 characters10 tokens

Aux 2015

Missed

4119712.

13 characters10 tokens

PiT-FT 2015

Missed
: 7856696.
 The special magic number for the most popular-sauce is: 7856696.
 The special magic number for the most popular-sauce is: 7856696.
 The special magic number for the most popular-sauce is

The same 66-character fragment repeats 6 times until the token limit. Showing the first three.

411 characters128 tokens

ChronoGPT 2015

Missed

: 2315122.<|endoftext|>

23 characters6 tokens