Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#000 · needle at 38% depth#001 · needle at 82% depth#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for condemned-crate is: 1262926.
One of the special magic numbers for cool-effectiveness is: 9423515.
[… 841 lines omitted for display …]
One of the special magic numbers for abortive-fleck is: 3237650.
One of the special magic numbers for plain-waist is: 3359406.
One of the special magic numbers for ritzy-envy is: 4126862.
One of the special magic numbers for agreeable-aquarium is: 5270062.
One of the special magic numbers for aspiring-sponsor is: 1781600.
One of the special magic numbers for tacit-tanker is: 4983170.
One of the special magic numbers for trashy-gas is: 9718692.
One of the special magic numbers for parched-formula is: 2378487.
One of the special magic numbers for aboard-vitamin is: 4390767.
One of the special magic numbers for hallowed-bias is: 2913141.
One of the special magic numbers for early-bafflement is: 4437571.
One of the special magic numbers for divergent-instance is: 2900119.
One of the special magic numbers for loving-mimosa is: 1211709.
One of the special magic numbers for ad hoc-truck is: 7285716.
[… 547 lines omitted for display …]
One of the special magic numbers for fast-win is: 4473726.
One of the special magic numbers for sparkling-battery is: 6607301.
What is the special magic number for parched-formula mentioned in the provided text?
Original prompt 32,201 tokens, 1,408 linesShown 20 lines around the needleNeedle at 60% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9397875Aux 20154473726Ours2378487Ours, no steer.2378487PiT-FT9397875Qwen 27B2378487
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2378487.

13 characters10 tokens

Aux 2015

Found the needle

4473726.

13 characters10 tokens

PiT-FT 2015

Missed
: 81057.
 The special magic number for the most popular-sauerkraut is: 81057.
 The special magic number for the most popular-sauerkraut is: 81057.
 The special magic number for the most popular-sauerkraut is

The same 69-character fragment repeats 6 times until the token limit. Showing the first three.

417 characters128 tokens

ChronoGPT 2015

Missed

:

Algorithm:

The special magic number for noxious-announce is:

Acr:

The special magic number for acrid-letter is:

Feat:

The special magic number for brewed-food is:

Haus:

The special magic number for brewed-Plant is:

Noodles:

The special magic number for brewed-Plant is:

Noodles:

The special magic number for brewed-Plant is:

Nonsense:

The special magic number for brewed-Plant is

423 characters128 tokens