Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#031 · needle at 41% depth#032 · needle at 22% depth#033 · needle at 20% depth#034 · needle at 52% depth#035 · needle at 72% depth#036 · needle at 26% depth#037 · needle at 10% depth#038 · needle at 17% depth#039 · needle at 25% depth#040 · needle at 29% depth#041 · needle at 58% depth#042 · needle at 89% depth#043 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elegant-zone is: 3343006.
One of the special magic numbers for cultured-distortion is: 5121609.
[… 22 lines omitted for display …]
One of the special magic numbers for mushy-oldie is: 6451382.
One of the special magic numbers for adorable-priest is: 8341700.
One of the special magic numbers for zonked-asparagus is: 7798482.
One of the special magic numbers for clammy-stockings is: 3580694.
One of the special magic numbers for dizzy-student is: 3506971.
One of the special magic numbers for rural-comma is: 4973772.
One of the special magic numbers for tranquil-plastic is: 1443165.
One of the special magic numbers for squalid-achievement is: 1899763.
One of the special magic numbers for lean-barrage is: 7479416.
One of the special magic numbers for helpless-cliff is: 5752706.
One of the special magic numbers for mute-mime is: 6917343.
One of the special magic numbers for furtive-chuck is: 1073332.
One of the special magic numbers for giant-investigation is: 7223984.
One of the special magic numbers for light-elderberry is: 6433167.
[… 288 lines omitted for display …]
One of the special magic numbers for damp-filing is: 3219842.
One of the special magic numbers for wary-fingernail is: 5026404.
What is the special magic number for squalid-achievement mentioned in the provided text?
Original prompt 7,662 tokens, 330 linesShown 20 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9013030Aux 20151899763Ours1899763Ours, no steer.1899763PiT-FT9013030Qwen 27B1899763
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1899763.

13 characters10 tokens

Aux 2015

Missed

7479416.

13 characters10 tokens

PiT-FT 2015

Missed

: 5694066. The special magic number for awkward-sprint is: 8805714. The special magic number for garrulous-sprint is: 8805714. The special magic number for garrulous-sprint is: 8805714. The special magic number for garrulous-sprint is: 8805714. The special magic number for garrulous-sprint is: 8805714. The special magic number for garrulous-sprint is: 8805714. The special magic number for garrulous-

409 characters128 tokens

ChronoGPT 2015

Missed

: 7144577.<|endoftext|>

23 characters7 tokens