Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#051 · needle at 76% depth#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dull-standing is: 4271706.
One of the special magic numbers for fortunate-revascularization is: 2148537.
[… 5,229 lines omitted for display …]
One of the special magic numbers for modern-sociology is: 8314433.
One of the special magic numbers for rough-canal is: 2000891.
One of the special magic numbers for peaceful-pusher is: 8553459.
One of the special magic numbers for round-rocket is: 8894969.
One of the special magic numbers for unbiased-great-grandmother is: 3226415.
One of the special magic numbers for overrated-boundary is: 9075120.
One of the special magic numbers for absent-pagan is: 3042337.
One of the special magic numbers for red-testimonial is: 6613954.
One of the special magic numbers for substantial-airfare is: 1553515.
One of the special magic numbers for scattered-lycra is: 8286233.
One of the special magic numbers for jazzy-interpreter is: 2703624.
One of the special magic numbers for protective-marshmallow is: 3545161.
One of the special magic numbers for hysterical-nightlight is: 4899150.
One of the special magic numbers for brainy-airspace is: 8185678.
[… 469 lines omitted for display …]
One of the special magic numbers for good-vanity is: 2095583.
One of the special magic numbers for empty-blouse is: 2610848.
What is the special magic number for red-testimonial mentioned in the provided text?
Original prompt 130,432 tokens, 5,718 linesShown 20 lines around the needleNeedle at 92% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1561410Aux 20153810683Ours6613954Ours, no steer.6613954PiT-FT1561410Qwen 27B6613954
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6613954.

13 characters10 tokens

Aux 2015

Missed

4227147.

13 characters10 tokens

PiT-FT 2015

Missed

a function of the size of the water in the air-ocean is a function of the size of the water in the ocean is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size of the water in the water is a function of the size

547 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean The special Elysian Epicurean

458 characters128 tokens