Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tiny-tenant is: 3937515.
One of the special magic numbers for adaptable-littleneck is: 6530497.
[… 181 lines omitted for display …]
One of the special magic numbers for luxuriant-orientation is: 1032549.
One of the special magic numbers for shrill-lament is: 9809721.
One of the special magic numbers for innate-pneumonia is: 6458916.
One of the special magic numbers for receptive-buffer is: 1932250.
One of the special magic numbers for crabby-rear is: 3413572.
One of the special magic numbers for ritzy-calorie is: 3355153.
One of the special magic numbers for courageous-chafe is: 4914927.
One of the special magic numbers for repulsive-midden is: 1998749.
One of the special magic numbers for sneaky-speaking is: 7089266.
One of the special magic numbers for shaggy-finger is: 3472430.
One of the special magic numbers for homeless-mystery is: 5718636.
One of the special magic numbers for impartial-tongue is: 3628872.
One of the special magic numbers for icy-barstool is: 5418152.
One of the special magic numbers for makeshift-water is: 8459220.
[… 489 lines omitted for display …]
One of the special magic numbers for hospitable-butler is: 1313582.
One of the special magic numbers for vengeful-reference is: 4674711.
What is the special magic number for repulsive-midden mentioned in the provided text?
Original prompt 15,865 tokens, 690 linesShown 20 lines around the needleNeedle at 28% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6647430Aux 20157064745Ours1998749Ours, no steer.1998749PiT-FT6647430Qwen 27B1998749
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1998749.

13 characters10 tokens

Aux 2015

Missed

9665571.

13 characters10 tokens

PiT-FT 2015

Missed

: 8276492. The special magic number for the most part-of-the-world is: 8276492. The special magic number for the most part-of-the-world mentioned in the provided text is: 8276492. The special magic number for the most part-of-the-world mentioned in the provided text is: 8276492. The special magic number for the most part-of-the-world mentioned in the provided text is: 8276492. The special magic number for the most part-of-the-world mentioned in the provided

466 characters128 tokens

ChronoGPT 2015

Missed

: 1334811.<|endoftext|>

23 characters6 tokens