Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wrathful-climate is: 1039203.
One of the special magic numbers for bloody-apron is: 1721843.
[… 1,118 lines omitted for display …]
One of the special magic numbers for animated-dew is: 3863818.
One of the special magic numbers for troubled-sprag is: 3223511.
One of the special magic numbers for warlike-tiara is: 1620915.
One of the special magic numbers for squeamish-state is: 6087566.
One of the special magic numbers for glossy-treasure is: 1019326.
One of the special magic numbers for fuzzy-dusk is: 6955855.
One of the special magic numbers for possessive-enjoyment is: 6834154.
One of the special magic numbers for hulking-bumper is: 6598382.
One of the special magic numbers for hallowed-filing is: 4711459.
One of the special magic numbers for eager-carport is: 8752640.
One of the special magic numbers for nonstop-nuke is: 5043017.
One of the special magic numbers for colorful-syrup is: 6955139.
One of the special magic numbers for excited-veranda is: 1051272.
One of the special magic numbers for outrageous-fennel is: 5854602.
[… 270 lines omitted for display …]
One of the special magic numbers for combative-joy is: 5038756.
One of the special magic numbers for better-incompetence is: 8658637.
What is the special magic number for hulking-bumper mentioned in the provided text?
Original prompt 32,125 tokens, 1,408 linesShown 20 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8831642Aux 20156852779Ours6598382Ours, no steer.6598382PiT-FT8831642Qwen 27B6598382
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6598382.

13 characters10 tokens

Aux 2015

Missed

4754160.

13 characters10 tokens

PiT-FT 2015

Missed

: 8870061. The special magic number for the most part-of-the-world is: 8870061. The special magic number for the least part-of-the-world is: 8870061. The special magic number for the most part-of-the-world is: 8870061. The special magic number for the least part-of-the-world is: 8870061. The special magic number for the least part-of-the-world is: 8870061. The special magic number for the least part-of-

412 characters128 tokens

ChronoGPT 2015

Missed

: 2885<|endoftext|>

19 characters4 tokens