Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dapper-whole is: 5842593.
One of the special magic numbers for juvenile-finisher is: 9156257.
[… 1,501 lines omitted for display …]
One of the special magic numbers for elderly-homeownership is: 9582439.
One of the special magic numbers for piquant-danger is: 5062621.
One of the special magic numbers for spurious-decision is: 5855741.
One of the special magic numbers for new-pledge is: 5051975.
One of the special magic numbers for cagey-paperwork is: 3539504.
One of the special magic numbers for rotten-eaves is: 3478197.
One of the special magic numbers for fearless-cauliflower is: 4159619.
One of the special magic numbers for finicky-bay is: 6485337.
One of the special magic numbers for exuberant-clutch is: 1057779.
One of the special magic numbers for immense-woman is: 8865837.
One of the special magic numbers for nutritious-liar is: 1382153.
One of the special magic numbers for annoyed-wrecker is: 5441240.
One of the special magic numbers for ahead-telephone is: 1875350.
One of the special magic numbers for wooden-charter is: 5251630.
[… 4,197 lines omitted for display …]
One of the special magic numbers for staking-raid is: 2650347.
One of the special magic numbers for sloppy-spat is: 4874822.
What is the special magic number for finicky-bay mentioned in the provided text?
Original prompt 130,398 tokens, 5,718 linesShown 20 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7849889Aux 20159684460Ours6485337Ours, no steer.6485337PiT-FT7849889Qwen 27B6485337
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6485337.

13 characters10 tokens

Aux 2015

Missed

2926695.

13 characters10 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean

458 characters128 tokens