Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth#068 · needle at 62% depth#069 · needle at 84% depth#070 · needle at 67% depth#071 · needle at 45% depth#072 · needle at 49% depth#073 · needle at 79% depth#074 · needle at 15% depth#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dazzling-director is: 1248158.
One of the special magic numbers for raspy-airman is: 4692828.
[… 2,591 lines omitted for display …]
One of the special magic numbers for deserted-farming is: 9567808.
One of the special magic numbers for gleaming-serval is: 3246643.
One of the special magic numbers for miniature-classification is: 9666384.
One of the special magic numbers for redundant-wiring is: 3419112.
One of the special magic numbers for disturbed-heartbeat is: 5766512.
One of the special magic numbers for resolute-quilt is: 7259141.
One of the special magic numbers for selective-beauty is: 6024851.
One of the special magic numbers for mammoth-cluster is: 7310493.
One of the special magic numbers for handsome-doorbell is: 2400529.
One of the special magic numbers for knotty-tsunami is: 3178534.
One of the special magic numbers for erect-wash is: 1649888.
One of the special magic numbers for weak-nutmeg is: 2458653.
One of the special magic numbers for invincible-chance is: 2691427.
One of the special magic numbers for direful-armament is: 9008666.
[… 3,107 lines omitted for display …]
One of the special magic numbers for frail-hydroxyl is: 4755040.
One of the special magic numbers for unarmed-briefs is: 3216810.
What is the special magic number for mammoth-cluster mentioned in the provided text?
Original prompt 130,374 tokens, 5,718 linesShown 20 lines around the needleNeedle at 45% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3391043Aux 20156295037Ours7310493Ours, no steer.7310493PiT-FT3391043Qwen 27B7310493
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7310493.

13 characters10 tokens

Aux 2015

Missed

5567767.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number does the author of the provided text use to represent the idea that the world is going to end in a firey-of a firey-fire is [] [, What number does the author of the provided text use to represent the idea that the world was created in [] [, What created the world is [] [, The author of the provided text uses this to [] [, What the heck does the author of the provided text use to represent the idea that the United States is the [] [ of the Antichrist, The author of the provided text explains this at the beginning
537 characters128 tokens

ChronoGPT 2015

Missed

:

Gen:

The special Epicurean-letter for rambunctious-cansity is:

Stupid-cansity:

Stupid-cansity:

Drunken-cous-mast mentioned in thealeb-

Drunken-somatic is:

Drunken-somatic is:

Drunken-sert is:

Drunken-sert is:

Drunken-sert is:

Drunken-sert is:

305 characters128 tokens