Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for stormy-osprey is: 4780952.
One of the special magic numbers for piquant-tsunami is: 1031352.
[… 288 lines omitted for display …]
One of the special magic numbers for solid-angora is: 1523804.
One of the special magic numbers for famous-tourist is: 3801477.
One of the special magic numbers for tacit-helo is: 8609901.
One of the special magic numbers for greedy-bridge is: 1477998.
One of the special magic numbers for wild-bondsman is: 6704870.
One of the special magic numbers for spicy-windage is: 8325323.
One of the special magic numbers for orange-mare is: 4005135.
One of the special magic numbers for early-rumor is: 1681596.
One of the special magic numbers for makeshift-lace is: 3349639.
One of the special magic numbers for brawny-login is: 3416449.
One of the special magic numbers for recondite-activation is: 2659738.
One of the special magic numbers for jittery-hoe is: 2302288.
One of the special magic numbers for courageous-pressroom is: 7489003.
One of the special magic numbers for jazzy-mare is: 9941975.
[… 357 lines omitted for display …]
One of the special magic numbers for dazzling-sale is: 7983123.
One of the special magic numbers for materialistic-adult is: 7584028.
What is the special magic number for early-rumor mentioned in the provided text?
Original prompt 15,322 tokens, 665 linesShown 20 lines around the needleNeedle at 45% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2731826Aux 20157476119Ours1681596Ours, no steer.1681596PiT-FT2731826Qwen 27B1681596
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1681596.

13 characters10 tokens

Aux 2015

Missed

6141200.

13 characters10 tokens

PiT-FT 2015

Missed
: 8805712.
 The special magic number for the most popular-soul is: 8805712.
 The special magic number for the most popular-soul is: 8805712.
 The special magic number for the most popular-soul is

The same 65-character fragment repeats 6 times until the token limit. Showing the first three.

439 characters128 tokens

ChronoGPT 2015

Missed

: 1319282.<|endoftext|>

23 characters6 tokens