Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#024 · needle at 68% depth#025 · needle at 34% depth#026 · needle at 95% depth#027 · needle at 4% depth#028 · needle at 78% depth#029 · needle at 20% depth#030 · needle at 57% depth#031 · needle at 20% depth#032 · needle at 78% depth#033 · needle at 34% depth#034 · needle at 70% depth#035 · needle at 32% depth#036 · needle at 33% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for rainy-astrology is: 5701744.
One of the special magic numbers for rebellious-railway is: 1393330.
[… 75 lines omitted for display …]
One of the special magic numbers for bashful-photoreceptor is: 9286653.
One of the special magic numbers for jittery-sampan is: 2013410.
One of the special magic numbers for swift-posterior is: 8215793.
One of the special magic numbers for brainy-tectonics is: 8481497.
One of the special magic numbers for abounding-spud is: 2480282.
One of the special magic numbers for icky-solution is: 7064624.
One of the special magic numbers for wandering-hydroxyl is: 2105263.
One of the special magic numbers for gamy-mug is: 4221613.
One of the special magic numbers for skillful-ark is: 5402967.
One of the special magic numbers for wry-guilty is: 6353005.
One of the special magic numbers for odd-mood is: 7008131.
One of the special magic numbers for piquant-dioxide is: 7215008.
One of the special magic numbers for pumped-basin is: 6037311.
One of the special magic numbers for poor-variation is: 6259232.
[… 51 lines omitted for display …]
One of the special magic numbers for hungry-monster is: 8989103.
One of the special magic numbers for gusty-wombat is: 6716959.
What is the special magic number for gamy-mug mentioned in the provided text?
Original prompt 3,492 tokens, 146 linesShown 20 lines around the needleNeedle at 57% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4762206Aux 20154221613Ours4221613Ours, no steer.4221613PiT-FT4762206Qwen 27B4221613
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4221613.

13 characters10 tokens

Aux 2015

Missed

6659210.

13 characters10 tokens

PiT-FT 2015

Missed

: 709857. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 827861. The special magic number for the most-firm is: 8

395 characters128 tokens

ChronoGPT 2015

Missed

: 7290901.<|endoftext|>

23 characters7 tokens