Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#044 · needle at 58% depth#045 · needle at 40% depth#046 · needle at 79% depth#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cloudy-faithful is: 4140141.
One of the special magic numbers for puny-initial is: 9609508.
[… 171 lines omitted for display …]
One of the special magic numbers for thinkable-glen is: 7382759.
One of the special magic numbers for sedate-curtain is: 3122622.
One of the special magic numbers for bawdy-dune is: 4865144.
One of the special magic numbers for flagrant-signup is: 6949562.
One of the special magic numbers for cautious-territory is: 7400971.
One of the special magic numbers for nonchalant-cartload is: 4321081.
One of the special magic numbers for colorful-documentation is: 9610929.
One of the special magic numbers for abject-father is: 1019519.
One of the special magic numbers for godly-exile is: 4854653.
One of the special magic numbers for handsomely-fiesta is: 3044899.
One of the special magic numbers for encouraging-employee is: 5995945.
One of the special magic numbers for likeable-foodstuffs is: 9074348.
One of the special magic numbers for aromatic-hose is: 2707106.
One of the special magic numbers for productive-grin is: 8939705.
[… 474 lines omitted for display …]
One of the special magic numbers for loose-attendant is: 3065346.
One of the special magic numbers for direful-grab-bag is: 2508041.
What is the special magic number for abject-father mentioned in the provided text?
Original prompt 15,345 tokens, 665 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9067696Aux 20156561834Ours1019519Ours, no steer.1019519PiT-FT9067696Qwen 27B1019519
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1019519.

13 characters10 tokens

Aux 2015

Missed

6981524.

13 characters10 tokens

PiT-FT 2015

Missed

: 6753381. The special magic number for the most recent-tender is: 8014742. The special magic number for the most recent-tender is: 8014742. The special magic number for the most recent-tender is: 8014742. The special magic number for the most recent-tender is: 8014742. The special magic number for the most recent-tender is: 8014742. The special magic number for the most recent-tender is: 8014742. The special magic number for the most

445 characters128 tokens

ChronoGPT 2015

Missed

: 7891021.<|endoftext|>

23 characters7 tokens