Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for melted-relief is: 2449607.
One of the special magic numbers for warlike-skullduggery is: 4842607.
[… 402 lines omitted for display …]
One of the special magic numbers for quack-resort is: 6493265.
One of the special magic numbers for crooked-guy is: 5633221.
One of the special magic numbers for dull-watcher is: 8688062.
One of the special magic numbers for diligent-cable is: 3998148.
One of the special magic numbers for good-explosion is: 7060870.
One of the special magic numbers for colorful-vinyl is: 9395998.
One of the special magic numbers for toothsome-illness is: 8301226.
One of the special magic numbers for acceptable-personnel is: 6322768.
One of the special magic numbers for upbeat-ancestor is: 2703293.
One of the special magic numbers for squalid-creationism is: 2745405.
One of the special magic numbers for sweltering-babushka is: 5968902.
One of the special magic numbers for robust-cure is: 4759426.
One of the special magic numbers for adventurous-mover is: 2399397.
One of the special magic numbers for aware-trade is: 1992893.
[… 2,423 lines omitted for display …]
One of the special magic numbers for angry-tram is: 3332970.
One of the special magic numbers for glorious-underweight is: 8681256.
What is the special magic number for toothsome-illness mentioned in the provided text?
Original prompt 64,916 tokens, 2,845 linesShown 20 lines around the needleNeedle at 14% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7266521Aux 20154754645Ours8301226Ours, no steer.8301226PiT-FT7266521Qwen 27B8301226
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8301226.

13 characters10 tokens

Aux 2015

Missed

4432014.

13 characters10 tokens

PiT-FT 2015

Missed

: 9903941. The special magic number for the most important-bob is: 8692036. The special magic number for the most effective-bun is: 8692057. The special magic number for the most popular-pug is: 8692057. The special magic number for the most effective-coconut is: 8292057. The special magic number for the most effective-sauce is: 8705769. The special magic number for the most effective-sir is: 8692057. The special magic number for

440 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for square-vitamin mentioned in the provided text is:

W:

The special magic number for square-vitamin mentioned in the provided text is:

W:

The special magic number for square-vitamin mentioned in the provided text is:

W:

The special magic number for square-vitamin mentioned in the provided text is:

W:

W:

W:

W:

W:

W:

W:

W

416 characters128 tokens