Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for delightful-processor is: 8866355.
One of the special magic numbers for rambunctious-ferret is: 4667106.
[… 60 lines omitted for display …]
One of the special magic numbers for lazy-papaya is: 6025528.
One of the special magic numbers for deafening-survey is: 1970797.
One of the special magic numbers for cool-colon is: 1107538.
One of the special magic numbers for determined-nightmare is: 6400466.
One of the special magic numbers for fat-yard is: 9295440.
One of the special magic numbers for ethereal-gemsbok is: 8506972.
One of the special magic numbers for teeny-flax is: 3233399.
One of the special magic numbers for hapless-waveform is: 5071316.
One of the special magic numbers for nice-blogger is: 7298463.
One of the special magic numbers for quizzical-footprint is: 8166061.
One of the special magic numbers for shrill-caddy is: 1795182.
One of the special magic numbers for dry-coal is: 2275180.
One of the special magic numbers for clever-woodland is: 4736155.
One of the special magic numbers for motionless-vault is: 7356014.
[… 2,765 lines omitted for display …]
One of the special magic numbers for economic-scrambled is: 6806135.
One of the special magic numbers for draconian-officer is: 3657903.
What is the special magic number for hapless-waveform mentioned in the provided text?
Original prompt 64,948 tokens, 2,845 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1484468Aux 20156310347Ours5071316Ours, no steer.5071316PiT-FT1484468Qwen 27B5071316
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5071316.

13 characters10 tokens

Aux 2015

Missed

9925505.

13 characters10 tokens

PiT-FT 2015

Missed

: 7691253. The special magic number for the most effective-sauce is: 8872082. The special magic number for the most effective-sugar is: 8872082. The special magic number for the most effective-soul is: 8872082. The special magic number for the most effective-soul is: 8872082. The special magic number for the most effective-sugar is: 8872082. The special magic number for the most effective-soul is: 8872082. The special magic number for the

449 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special Magic Number number is:

L:

The special Magic number mentioned in the provided text is:

N:

The special Magic number mentioned in the provided text is:

C:

The special Magic number mentioned in the provided text is:

C:

The special Magic number mentioned in the provided text is:

N:

N:

N:

C:

N:

N:

N:

C:

C:

395 characters128 tokens