Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for waggish-travel is: 9210097.
One of the special magic numbers for jagged-instructor is: 7969211.
[… 645 lines omitted for display …]
One of the special magic numbers for sour-marksman is: 7584849.
One of the special magic numbers for elegant-priest is: 2745974.
One of the special magic numbers for incompetent-tailbud is: 9123846.
One of the special magic numbers for panicky-cyclone is: 3324984.
One of the special magic numbers for smiling-chin is: 2867185.
One of the special magic numbers for exclusive-vodka is: 5016479.
One of the special magic numbers for wacky-brook is: 7189028.
One of the special magic numbers for gullible-scraper is: 5235699.
One of the special magic numbers for purring-problem is: 2982163.
One of the special magic numbers for sleepy-poet is: 5434098.
One of the special magic numbers for helpless-pawnshop is: 3348970.
One of the special magic numbers for substantial-hearthside is: 6292463.
One of the special magic numbers for cold-seafood is: 4022579.
One of the special magic numbers for auspicious-frog is: 4081810.
One of the special magic numbers for uninterested-courthouse is: 3684028.
One of the special magic numbers for typical-courtroom is: 4286417.
What is the special magic number for uninterested-courthouse mentioned in the provided text?
Original prompt 15,290 tokens, 665 linesShown 20 lines around the needleNeedle at 99% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9380894Aux 20151256845Ours3684028Ours, no steer.3684028PiT-FT9380894Qwen 27B3684028
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3684028.

13 characters10 tokens

Aux 2015

Missed

7223335.

13 characters10 tokens

PiT-FT 2015

Missed

: 8576572. The special magic number for the most popular-soul is: 8576572. The special magic number for the least popular-soul is: 8576572. The special magic number for the most popular-soul is: 8576572. The special magic number for the least popular-soul is: 8576572. The special magic number for the most popular-soul is: 8576572. The special magic number for the least popular-soul is: 8576572. The special magic number for the most

442 characters128 tokens

ChronoGPT 2015

Missed

: 7351831.<|endoftext|>

23 characters7 tokens