Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lamentable-destination is: 8220852.
One of the special magic numbers for gaudy-tomography is: 6361049.
[… 283 lines omitted for display …]
One of the special magic numbers for wholesale-south is: 7489020.
One of the special magic numbers for standing-runway is: 3656604.
One of the special magic numbers for spiffy-howard is: 5222716.
One of the special magic numbers for earsplitting-scheduling is: 9886972.
One of the special magic numbers for tough-detail is: 9535923.
One of the special magic numbers for wide-eyed-battleship is: 3891532.
One of the special magic numbers for utopian-broadcast is: 1806324.
One of the special magic numbers for pumped-shearling is: 6396929.
One of the special magic numbers for entertaining-department is: 5798453.
One of the special magic numbers for cooing-substitution is: 3444698.
One of the special magic numbers for lucky-futon is: 6603469.
One of the special magic numbers for astonishing-angle is: 6386163.
One of the special magic numbers for scrawny-possession is: 3454326.
One of the special magic numbers for ill-sauce is: 5182041.
[… 387 lines omitted for display …]
One of the special magic numbers for melted-pentagon is: 6537515.
One of the special magic numbers for wacky-comb is: 7125111.
What is the special magic number for pumped-shearling mentioned in the provided text?
Original prompt 15,866 tokens, 690 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4805992Aux 20151413900Ours6396929Ours, no steer.6396929PiT-FT4805992Qwen 27B6396929
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6396929.

13 characters10 tokens

Aux 2015

Missed

4088976.

13 characters10 tokens

PiT-FT 2015

Missed

: 7871167. The special magic number for the most recent-tide is: 8871272. The special magic number for the most recent-tide is: 8871272. The special magic number for the most recent-tide is: 8871272. The special magic number for the most recent-tide is: 8871272. The special magic number for the most recent-tide is: 8871272. The special magic number for the most recent-tide is: 8871272. The special magic number for the most

433 characters128 tokens

ChronoGPT 2015

Missed

: 1483503.<|endoftext|>

23 characters6 tokens