Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for faded-respect is: 3700195.
One of the special magic numbers for needless-stake is: 7244451.
[… 4,704 lines omitted for display …]
One of the special magic numbers for honorable-university is: 9129749.
One of the special magic numbers for trite-grouse is: 3651635.
One of the special magic numbers for tacit-scraper is: 6245004.
One of the special magic numbers for sticky-poignance is: 7379926.
One of the special magic numbers for quack-line is: 3943297.
One of the special magic numbers for greasy-yacht is: 4103746.
One of the special magic numbers for neighborly-denim is: 5983143.
One of the special magic numbers for lowly-temptress is: 4375867.
One of the special magic numbers for round-corridor is: 8221718.
One of the special magic numbers for animated-patroller is: 8555720.
One of the special magic numbers for legal-gliding is: 4243349.
One of the special magic numbers for sulky-quartz is: 4458156.
One of the special magic numbers for moldy-forestry is: 5537946.
One of the special magic numbers for strong-marines is: 8391949.
[… 994 lines omitted for display …]
One of the special magic numbers for fabulous-assistant is: 9812116.
One of the special magic numbers for accessible-chef is: 4430810.
What is the special magic number for lowly-temptress mentioned in the provided text?
Original prompt 130,443 tokens, 5,718 linesShown 20 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5254026Aux 20157641967Ours4375867Ours, no steer.4375867PiT-FT5254026Qwen 27B4375867
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4375867.

13 characters10 tokens

Aux 2015

Missed

5892888.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [].
The special magic number for the silent-pug is: 4563569.
The special magic numbers for the waggish-tug is: 8873474.
The special magic numbers for the piquant-pug is: 6876669.
The special magic numbers for the snotty-sauce is: 6696669.
The special magic numbers for the lop-suscept is: 7581732.
The special magic numbers for the waggish-tug is: 7691717.
The special magic numbers
386 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean, the special Dickens, the special Gavian, the special

Sore-cuss is:

Quixotic-cuss is:

Vile-pilgrasm is:

Vile-pilgrasm is:

Vile-pilgrasm is:

Vile-pilgrasm is:

Vile-pilgrasm is:

Vile-pilgrasm is:

277 characters128 tokens