Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bloody-squirrel is: 5336519.
One of the special magic numbers for hushed-insert is: 6917293.
[… 812 lines omitted for display …]
One of the special magic numbers for gainful-anatomy is: 8675332.
One of the special magic numbers for imperfect-manacle is: 2197698.
One of the special magic numbers for slow-sewer is: 7248692.
One of the special magic numbers for tiny-closure is: 5490922.
One of the special magic numbers for adorable-antelope is: 6486637.
One of the special magic numbers for sour-field is: 6312825.
One of the special magic numbers for aromatic-peer-to-peer is: 8839879.
One of the special magic numbers for smoggy-scheduling is: 6714987.
One of the special magic numbers for frightened-perpendicular is: 4590542.
One of the special magic numbers for enchanting-barbiturate is: 6751975.
One of the special magic numbers for naive-papaya is: 3324399.
One of the special magic numbers for courageous-growth is: 9135482.
One of the special magic numbers for weak-explorer is: 8241555.
One of the special magic numbers for racial-battery is: 3102462.
[… 551 lines omitted for display …]
One of the special magic numbers for goofy-list is: 2600334.
One of the special magic numbers for young-inequality is: 9438125.
What is the special magic number for smoggy-scheduling mentioned in the provided text?
Original prompt 31,685 tokens, 1,383 linesShown 20 lines around the needleNeedle at 59% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7398712Aux 20159661043Ours6714987Ours, no steer.6714987PiT-FT7398712Qwen 27B6714987
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6714987.

13 characters10 tokens

Aux 2015

Missed

5440565.

13 characters10 tokens

PiT-FT 2015

Missed

: 7597741. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most recent-turtle is: 8223955. The special magic number for the most

445 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for wacky-flop?

Answer:

The special magic number for wacky-flop is:

Question:

What is the special magic number for wacky-mangrove?

Answer:

The special magic number for wacky-mangrove is:

Question:

What is the special magic number for wacky-milk?

Answer:

The special magic number for wacky-milk is:

Question:

What is the special magic number

420 characters128 tokens