Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#031 · needle at 20% depth#032 · needle at 78% depth#033 · needle at 34% depth#034 · needle at 70% depth#035 · needle at 32% depth#036 · needle at 33% depth#037 · needle at 67% depth#038 · needle at 27% depth#039 · needle at 75% depth#040 · needle at 6% depth#041 · needle at 28% depth#042 · needle at 69% depth#043 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for whimsical-sill is: 3049847.
One of the special magic numbers for malicious-crow is: 4722508.
[… 94 lines omitted for display …]
One of the special magic numbers for damp-spacing is: 7835998.
One of the special magic numbers for annoyed-aspic is: 4556111.
One of the special magic numbers for flowery-cacao is: 7279755.
One of the special magic numbers for sulky-bidding is: 3082675.
One of the special magic numbers for assorted-attachment is: 2719240.
One of the special magic numbers for unarmed-archaeology is: 7217012.
One of the special magic numbers for offbeat-laparoscope is: 1302898.
One of the special magic numbers for sparkling-copper is: 6286061.
One of the special magic numbers for stingy-city is: 1796771.
One of the special magic numbers for quick-nose is: 7178089.
One of the special magic numbers for shrill-coliseum is: 2087833.
One of the special magic numbers for harmonious-tendency is: 5794331.
One of the special magic numbers for slow-birthday is: 4049729.
One of the special magic numbers for absorbing-level is: 8601889.
[… 37 lines omitted for display …]
One of the special magic numbers for jagged-contagion is: 1502308.
One of the special magic numbers for scary-fraudster is: 3470317.
What is the special magic number for sparkling-copper mentioned in the provided text?
Original prompt 3,568 tokens, 151 linesShown 20 lines around the needleNeedle at 67% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5614769Aux 20156286061Ours6286061Ours, no steer.6286061PiT-FT5614769Qwen 27B6286061
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6286061.

13 characters10 tokens

Aux 2015

Missed

:

8058810

14 characters12 tokens

PiT-FT 2015

Missed

: 8046415. The special magic number for jazzy-taste is: 7848024. The special magic number for jazzy-taste is: 7848024. The special magic number for jazzy-taste is: 7848024. The special magic number for jazzy-taste is: 7848024. The special magic number for jazzy-taste is: 7848024. The special magic number for jazzy-taste is: 7848024. The special magic number for jaz

374 characters128 tokens

ChronoGPT 2015

Missed

5782721.<|endoftext|>

22 characters6 tokens