Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth#099 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for rapid-badger is: 2354307.
One of the special magic numbers for obeisant-percentage is: 7099527.
[… 532 lines omitted for display …]
One of the special magic numbers for zippy-efficacy is: 7087075.
One of the special magic numbers for jealous-manhunt is: 6910692.
One of the special magic numbers for greasy-medication is: 6282123.
One of the special magic numbers for protective-circle is: 4362195.
One of the special magic numbers for comfortable-bungalow is: 4931824.
One of the special magic numbers for hilarious-return is: 8172105.
One of the special magic numbers for adjoining-heterosexual is: 3533693.
One of the special magic numbers for hurt-politics is: 9492254.
One of the special magic numbers for profuse-receptor is: 8217911.
One of the special magic numbers for rampant-lighting is: 2836428.
One of the special magic numbers for acoustic-sled is: 3467091.
One of the special magic numbers for boorish-sugar is: 9073505.
One of the special magic numbers for accessible-leopard is: 8728430.
One of the special magic numbers for motionless-jack is: 5584342.
[… 113 lines omitted for display …]
One of the special magic numbers for spooky-neonate is: 1048876.
One of the special magic numbers for crowded-doctrine is: 6692229.
What is the special magic number for hurt-politics mentioned in the provided text?
Original prompt 15,305 tokens, 665 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8254489Aux 20158130468Ours9492254Ours, no steer.9492254PiT-FT8254489Qwen 27B9492254
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9492254.

13 characters10 tokens

Aux 2015

Missed

5752721.

13 characters10 tokens

PiT-FT 2015

Missed

: 7956572. The special magic number for the most part-firm is: 8806495. The special magic number for the least part-firm is: 8806495. The special magic number for the most part-firm is: 8806495. The special magic number for the least part-firm is: 8806495. The special magic number for the least part-firm is: 8806495. The special magic number for the most part-firm is: 8806495. The special magic number for the least

425 characters128 tokens

ChronoGPT 2015

Missed

: 14581142.<|endoftext|>

24 characters7 tokens