Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for scandalous-corps is: 3936914.
One of the special magic numbers for rapid-planet is: 9952044.
[… 2,407 lines omitted for display …]
One of the special magic numbers for measly-dew is: 3455077.
One of the special magic numbers for fat-reversal is: 4461666.
One of the special magic numbers for vast-hiking is: 1352911.
One of the special magic numbers for breakable-characterization is: 6269073.
One of the special magic numbers for shy-thistle is: 4178515.
One of the special magic numbers for friendly-peacoat is: 1251504.
One of the special magic numbers for hissing-wardrobe is: 9729568.
One of the special magic numbers for pastoral-menorah is: 6644979.
One of the special magic numbers for itchy-supermarket is: 9290568.
One of the special magic numbers for lopsided-refrigerator is: 4054342.
One of the special magic numbers for sticky-nickname is: 3631777.
One of the special magic numbers for defeated-clarity is: 3318148.
One of the special magic numbers for nutty-cross-stitch is: 6537317.
One of the special magic numbers for grandiose-commonsense is: 2111368.
[… 418 lines omitted for display …]
One of the special magic numbers for supreme-panpipe is: 6801522.
One of the special magic numbers for ruddy-corridor is: 4360454.
What is the special magic number for pastoral-menorah mentioned in the provided text?
Original prompt 65,006 tokens, 2,845 linesShown 20 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8029895Aux 20156967748Ours6644979Ours, no steer.6644979PiT-FT8029895Qwen 27B6644979
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6644979.

13 characters10 tokens

Aux 2015

Missed

8734193.

13 characters10 tokens

PiT-FT 2015

Missed

: 6690876. The special magic number for the most recent-turtle is: 7690876. The special magic number for the most recent-saucer is: 7690876. The special magic number for the most recent-snow is: 6690876. The special magic number for the most recent-snow is: 6690876. The special magic number for the most recent-snow is: 6690876. The special magic number for the most recent-snow is: 6690876. The special magic number for the

432 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for quirky-decision is:
The special magic number for quirky-decision is:
The special magic number for quirky-decision is

The same 49-character fragment repeats 8 times until the token limit. Showing the first three.

521 characters128 tokens