Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#045 · needle at 38% depth#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth#049 · needle at 19% depth#050 · needle at 26% depth#051 · needle at 76% depth#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for threatening-shoemaker is: 8491932.
One of the special magic numbers for venomous-answer is: 9486750.
[… 4,337 lines omitted for display …]
One of the special magic numbers for burly-charger is: 5567034.
One of the special magic numbers for knowledgeable-randomisation is: 9281691.
One of the special magic numbers for ripe-wit is: 8181489.
One of the special magic numbers for wise-deed is: 9482535.
One of the special magic numbers for crooked-spasm is: 1877252.
One of the special magic numbers for overrated-vogue is: 2591091.
One of the special magic numbers for moaning-sauce is: 2694073.
One of the special magic numbers for unarmed-sunflower is: 1571692.
One of the special magic numbers for null-gondola is: 6380949.
One of the special magic numbers for unbecoming-astrolabe is: 2835474.
One of the special magic numbers for legal-heirloom is: 7239915.
One of the special magic numbers for billowy-hydroxyl is: 3683361.
One of the special magic numbers for famous-bicycle is: 3149710.
[… 1,362 lines omitted for display …]
One of the special magic numbers for lopsided-sister-in-law is: 5856320.
One of the special magic numbers for gainful-sitar is: 1324945.
What is the special magic number for moaning-sauce mentioned in the provided text?
Original prompt 130,444 tokens, 5,718 linesShown 19 lines around the needleNeedle at 76% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6876554Aux 20152235979Ours2694073Ours, no steer.2694073PiT-FT6876554Qwen 27B2694073
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2694073.

13 characters10 tokens

Aux 2015

Missed

9620080.

13 characters10 tokens

PiT-FT 2015

Missed

a function and not a variable.

  • [address|code] cc: The Magic Numbers <|counsel|code> Receipt for the special magic numbers for the gaudy-gift is: 8105769. Receipt for the special magic numbers for the sanguine-sauce is: 8105769. Receipt for the special magic numbers for the waggish-wobble is: 8870069. Receipt for the special magic numbers for the gaudy-gift is: 8870069.
375 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Epicurean Eccentricity mentioned in theeka's

Truly:

The special Epicurean Ab of the sordid-type is

Stupid-cans is:

Drunken-cans is:

Drunken-cans is:

Drunken-sors are:

Drunken-sors are:

Drunken-sers are:

344 characters128 tokens