Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#007 · needle at 11% depth#008 · needle at 30% depth#009 · needle at 3% depth#010 · needle at 15% depth#011 · needle at 91% depth#012 · needle at 61% depth#013 · needle at 6% depth#014 · needle at 2% depth#015 · needle at 65% depth#016 · needle at 28% depth#017 · needle at 73% depth#018 · needle at 59% depth#019 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for macho-ambition is: 8993331.
One of the special magic numbers for greasy-beverage is: 8097946.
One of the special magic numbers for cagey-nightingale is: 8088983.
One of the special magic numbers for level-intensity is: 4126532.
One of the special magic numbers for nonchalant-unit is: 8147380.
One of the special magic numbers for capable-wake is: 1678438.
One of the special magic numbers for ragged-variable is: 6733527.
One of the special magic numbers for possessive-online is: 8473283.
One of the special magic numbers for overjoyed-fabric is: 4761958.
One of the special magic numbers for thundering-ambiguity is: 3601637.
One of the special magic numbers for profuse-pillar is: 9846268.
One of the special magic numbers for tart-prohibition is: 9802632.
One of the special magic numbers for breezy-stuff is: 5877187.
One of the special magic numbers for panicky-cat is: 8337608.
One of the special magic numbers for boundless-underwear is: 9012989.
One of the special magic numbers for hilarious-menopause is: 3493203.
[… 131 lines omitted for display …]
One of the special magic numbers for organic-hill is: 9659648.
One of the special magic numbers for utter-silo is: 7069566.
What is the special magic number for possessive-online mentioned in the provided text?
Original prompt 3,567 tokens, 151 linesShown 20 lines around the needleNeedle at 6% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8031349Aux 20152612483Ours8473283Ours, no steer.8473283PiT-FT8031349Qwen 27B8473283
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8473283.

13 characters10 tokens

Aux 2015

Found the needle

2612483.

13 characters10 tokens

PiT-FT 2015

Found the needle

: 8031349

9 characters5 tokens

ChronoGPT 2015

Missed

: 7359843.<|endoftext|>

23 characters7 tokens