Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fancy-overflight is: 7060840.
One of the special magic numbers for omniscient-loading is: 7442212.
[… 448 lines omitted for display …]
One of the special magic numbers for abrasive-marketplace is: 5934890.
One of the special magic numbers for brief-answer is: 2484064.
One of the special magic numbers for ancient-senator is: 9255743.
One of the special magic numbers for long-lay is: 5647257.
One of the special magic numbers for funny-vignette is: 8811280.
One of the special magic numbers for victorious-watermelon is: 1210314.
One of the special magic numbers for smooth-ischemia is: 9473286.
One of the special magic numbers for icky-chauvinist is: 3149212.
One of the special magic numbers for tranquil-section is: 4303103.
One of the special magic numbers for protective-airplane is: 4651308.
One of the special magic numbers for determined-detector is: 2485838.
One of the special magic numbers for smiling-depression is: 1321172.
One of the special magic numbers for accidental-cinder is: 4796461.
One of the special magic numbers for nutritious-evaporation is: 4759861.
[… 940 lines omitted for display …]
One of the special magic numbers for weak-swim is: 3543325.
One of the special magic numbers for workable-tripod is: 6540238.
What is the special magic number for icky-chauvinist mentioned in the provided text?
Original prompt 32,214 tokens, 1,408 linesShown 20 lines around the needleNeedle at 32% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9751333Aux 20152543132Ours3149212Ours, no steer.3149212PiT-FT9751333Qwen 27B3149212
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3149212.

13 characters10 tokens

Aux 2015

Missed

7677971.

13 characters10 tokens

PiT-FT 2015

Missed

: 7872917. The special magic number for the most important-carnival is: 9873074. The special magic number for the most significant-carnival is: 9873074. The special magic number for the most significant-soul is: 9873074. The special magic number for the most significant-soul is: 9873074. The special magic number for the most significant-soul is: 9873074. The special magic number for the most significant-soul is: 9873074. The special magic number for

460 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for whimsical-imaginary?

Answer:

The special magic number for whimsical-imaginary is:

Question:

What is the special magic number for whimsical-imaginary?

Answer:

The special magic number for whimsical-imaginary is:

Answer:

The special magic number for whimsical-imaginary is:

Question:

What is the special magic number for whimsical-imaginary?

Answer:

The special magic number for whimsical-imaginary

480 characters128 tokens