Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for abrasive-top is: 3066033.
One of the special magic numbers for warm-tram is: 6402215.
[… 2,044 lines omitted for display …]
One of the special magic numbers for open-contrail is: 5490808.
One of the special magic numbers for instinctive-eclipse is: 4987228.
One of the special magic numbers for faithful-brass is: 1905322.
One of the special magic numbers for adhesive-mandolin is: 9277309.
One of the special magic numbers for abject-piglet is: 7618764.
One of the special magic numbers for nebulous-puma is: 2727613.
One of the special magic numbers for nutty-commercial is: 4222427.
One of the special magic numbers for attractive-calendar is: 7307587.
One of the special magic numbers for tacit-checkout is: 8088013.
One of the special magic numbers for mighty-friction is: 8994589.
One of the special magic numbers for impossible-mess is: 9577825.
One of the special magic numbers for watchful-chinchilla is: 5372048.
One of the special magic numbers for boring-figurine is: 6782407.
One of the special magic numbers for abundant-hunter is: 8824170.
[… 781 lines omitted for display …]
One of the special magic numbers for watery-pneumonia is: 4757766.
One of the special magic numbers for Early-vermicelli is: 7170901.
What is the special magic number for attractive-calendar mentioned in the provided text?
Original prompt 65,010 tokens, 2,845 linesShown 20 lines around the needleNeedle at 72% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7778248Aux 20156811240Ours7307587Ours, no steer.7307587PiT-FT7778248Qwen 27B7307587
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7307587.

13 characters10 tokens

Aux 2015

Missed

8448772.

13 characters10 tokens

PiT-FT 2015

Missed

: 7103901. The special magic number for sluggish-sauerk is: 7572390. The special magic number for icky-coconut is: 7103901. The special magic number for gassy-sap is: 7103901. The special magic number for icky-coconut is: 7103901. The special magic number for sluggish-sap is: 7103901. The special magic number for gassy-sap is: 7103901. The special magic number for icky-coconut is

389 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for quicks-theory is:

W:

The special Magic Number number for the text is:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

W:

264 characters128 tokens