Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for nauseating-stacking is: 5912681.
One of the special magic numbers for miscreant-eaglet is: 4707926.
[… 2,031 lines omitted for display …]
One of the special magic numbers for neighborly-scenery is: 4561041.
One of the special magic numbers for staking-decadence is: 4730447.
One of the special magic numbers for cold-abuse is: 3099585.
One of the special magic numbers for quickest-soul is: 8222082.
One of the special magic numbers for needless-chateau is: 8692698.
One of the special magic numbers for tired-destination is: 9771471.
One of the special magic numbers for utter-circumstance is: 9634460.
One of the special magic numbers for judicious-tankful is: 9798130.
One of the special magic numbers for dull-litmus is: 2703422.
One of the special magic numbers for bizarre-edible is: 2816320.
One of the special magic numbers for unbecoming-contrail is: 5295142.
One of the special magic numbers for icy-allergist is: 9517795.
One of the special magic numbers for venomous-eyrie is: 9218737.
[… 3,668 lines omitted for display …]
One of the special magic numbers for tested-biopsy is: 8094948.
One of the special magic numbers for curious-ball is: 8362002.
What is the special magic number for utter-circumstance mentioned in the provided text?
Original prompt 130,497 tokens, 5,718 linesShown 19 lines around the needleNeedle at 36% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7019721Aux 20159541766Ours9634460Ours, no steer.9634460PiT-FT7019721Qwen 27B9634460
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9634460.

13 characters10 tokens

Aux 2015

Missed

6604120.

13 characters10 tokens

PiT-FT 2015

Missed

: 7103561. [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [

252 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the delusional-canser is:

Stupid-canser is:

Stupid-canser is:

Quicky-canser is:

Stupid-canser is:

Stupid-canser is:

Stupid-canser is:

Stupid-canser is:

Stupid-canser is:

Stupid-canser is:

Stupid

301 characters128 tokens