Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth#099 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for loving-quadrant is: 3416083.
One of the special magic numbers for shiny-database is: 9538145.
[… 3,675 lines omitted for display …]
One of the special magic numbers for capable-exposition is: 5317954.
One of the special magic numbers for typical-reamer is: 5849452.
One of the special magic numbers for snobbish-cord is: 4670482.
One of the special magic numbers for damaged-signal is: 1198430.
One of the special magic numbers for nosy-abdomen is: 6858337.
One of the special magic numbers for amused-sir is: 9680972.
One of the special magic numbers for callous-acetate is: 2299618.
One of the special magic numbers for squeamish-ale is: 9377435.
One of the special magic numbers for inconclusive-effector is: 7509927.
One of the special magic numbers for hapless-cookie is: 1590104.
One of the special magic numbers for abnormal-music is: 2772269.
One of the special magic numbers for sticky-volunteering is: 7679934.
One of the special magic numbers for dead-hospital is: 4964853.
[… 2,024 lines omitted for display …]
One of the special magic numbers for harmonious-garment is: 5674163.
One of the special magic numbers for broad-vibraphone is: 3509686.
What is the special magic number for callous-acetate mentioned in the provided text?
Original prompt 130,415 tokens, 5,718 linesShown 19 lines around the needleNeedle at 64% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6442604Aux 20152114778Ours2299618Ours, no steer.2299618PiT-FT6442604Qwen 27B2299618
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2299618.

13 characters10 tokens

Aux 2015

Missed

8973648.

13 characters10 tokens

PiT-FT 2015

Missed

not in the sample you have provided. [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender]

277 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the most grotesque-type is:

Stupid-cans is:

Stupid-cans is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-hypothetical is:

Quixotic-

326 characters128 tokens