Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wonderful-cue is: 8226752.
One of the special magic numbers for boorish-cabin is: 5590830.
[… 4,462 lines omitted for display …]
One of the special magic numbers for jolly-economy is: 9542978.
One of the special magic numbers for clammy-transportation is: 9756312.
One of the special magic numbers for curious-restriction is: 1135451.
One of the special magic numbers for grubby-circuit is: 7390647.
One of the special magic numbers for handsomely-raincoat is: 8043695.
One of the special magic numbers for exotic-retention is: 1097455.
One of the special magic numbers for childlike-sunbonnet is: 4557844.
One of the special magic numbers for soft-blush is: 8702847.
One of the special magic numbers for mysterious-priority is: 1763106.
One of the special magic numbers for important-median is: 2941344.
One of the special magic numbers for wiry-politics is: 6153209.
One of the special magic numbers for taboo-quarter is: 4989082.
One of the special magic numbers for nondescript-dough is: 2875239.
[… 1,237 lines omitted for display …]
One of the special magic numbers for absurd-inhibitor is: 1808919.
One of the special magic numbers for Early-deviation is: 8793225.
What is the special magic number for childlike-sunbonnet mentioned in the provided text?
Original prompt 130,385 tokens, 5,718 linesShown 19 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6215102Aux 20152155262Ours4557844Ours, no steer.4557844PiT-FT6215102Qwen 27B4557844
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4557844.

13 characters10 tokens

Aux 2015

Missed

4165947.

13 characters10 tokens

PiT-FT 2015

Missed

not provided. And what is the special magic number for the following text? [assistant] Certainly, the special magic numbers for the following text are: 6870176. This is a great way to start a day:

[text] Certainly, the special magic numbers for the following text are provided. Certainly, the special magic numbers for the following text are not provided. Certainly, the special magic numbers for the following text are provided. Certainly, the special magic numbers for the following text are not provided. Certainly, the special magic numbers for the following text are provided.

584 characters128 tokens

ChronoGPT 2015

Missed

:

Stats:

The special Epicurean Epicurean Epicurean

Rift:

The special Epicurean Epicurean

Sore-cansil is:

Sore-cansil is:

Sore-mast is:

Sore-pant is:

Vile:

The special Epicurean Vile is the special Epicurean Vile

Vile:

Vile:

Vile:

Vile:

Vile:

Vile:

311 characters128 tokens