Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dashing-barbecue is: 7471346.
One of the special magic numbers for old-platypus is: 2412083.
[… 4,631 lines omitted for display …]
One of the special magic numbers for receptive-diagnosis is: 1242335.
One of the special magic numbers for mighty-stitch is: 4554560.
One of the special magic numbers for clean-lottery is: 7189256.
One of the special magic numbers for shaky-pilgrimage is: 8766893.
One of the special magic numbers for immense-shakedown is: 3827597.
One of the special magic numbers for slow-vine is: 5590167.
One of the special magic numbers for slow-buggy is: 1258318.
One of the special magic numbers for tangible-bit is: 7671705.
One of the special magic numbers for garrulous-photo is: 2513564.
One of the special magic numbers for round-motorboat is: 7401810.
One of the special magic numbers for gusty-warrant is: 7469711.
One of the special magic numbers for precious-cummerbund is: 4136477.
One of the special magic numbers for flagrant-act is: 9479299.
One of the special magic numbers for enthusiastic-sequence is: 1054387.
[… 1,067 lines omitted for display …]
One of the special magic numbers for truculent-hazel is: 1336657.
One of the special magic numbers for flagrant-grid is: 5790926.
What is the special magic number for tangible-bit mentioned in the provided text?
Original prompt 130,297 tokens, 5,718 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9243976Aux 20154272056Ours7671705Ours, no steer.7671705PiT-FT9243976Qwen 27B7671705
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7671705.

13 characters10 tokens

Aux 2015

Missed

8593475.

13 characters10 tokens

PiT-FT 2015

Missed

: 7876569. What other information might be included to make the answer more interesting? .[ ]assistant[ []he of the special magic numbers for the following text is: 7876569. The special magic numbers for the following text is: 7876569. The special magic numbers for the following text is: 7876569. The special magic numbers for the following text is: 7876569. The special magic numbers for the following text is: 7876569. The special magic numbers for the following text is: 787

481 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean, the special Quixotic-hypothetical, the special Quixotic-hypothetical forabbling-canser is:

Stupid-cous is:

Stupid-cous is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

333 characters128 tokens