Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#004 · needle at 80% depth#005 · needle at 96% depth#006 · needle at 38% depth#007 · needle at 3% depth#008 · needle at 38% depth#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for temporary-slot is: 3314707.
One of the special magic numbers for agreeable-promenade is: 1916200.
[… 907 lines omitted for display …]
One of the special magic numbers for efficacious-seed is: 5015266.
One of the special magic numbers for yellow-information is: 8698283.
One of the special magic numbers for gaudy-sir is: 7389449.
One of the special magic numbers for rambunctious-alder is: 1539492.
One of the special magic numbers for ceaseless-mayor is: 4131671.
One of the special magic numbers for sticky-application is: 8435222.
One of the special magic numbers for flawless-patio is: 6004275.
One of the special magic numbers for wacky-limitation is: 2798168.
One of the special magic numbers for unable-marriage is: 6635387.
One of the special magic numbers for lyrical-taro is: 1372499.
One of the special magic numbers for abnormal-crow is: 8242422.
One of the special magic numbers for truculent-gymnast is: 9579866.
One of the special magic numbers for real-brick is: 7454954.
One of the special magic numbers for fierce-displacement is: 3113494.
[… 4,791 lines omitted for display …]
One of the special magic numbers for shiny-crow is: 9930665.
One of the special magic numbers for melodic-colleague is: 3330788.
What is the special magic number for wacky-limitation mentioned in the provided text?
Original prompt 130,444 tokens, 5,718 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3463046Aux 20151409869Ours2798168Ours, no steer.2798168PiT-FT3463046Qwen 27B2798168
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2798168.

13 characters10 tokens

Aux 2015

Missed

9690641.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Haus:

The special Epicurean Epicurus-like-cans is:

Haus:

The special Epicurean Elysium-like-cans is:

Haus:

The special Epicurean Elysium-yk is:

Haus:

The special Epicurean Elysium-okra is:

Haus:

The special Epicurean Elysium-okra is:

Haus:

The special Elysium-okra Elysium-okra is:

327 characters128 tokens