Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#067 · needle at 9% depth#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for alcoholic-saint is: 9122784.
One of the special magic numbers for wanting-daffodil is: 5342993.
[… 2,506 lines omitted for display …]
One of the special magic numbers for overrated-private is: 9409952.
One of the special magic numbers for famous-ruffle is: 9065130.
One of the special magic numbers for woebegone-personnel is: 8501270.
One of the special magic numbers for abortive-tongue is: 7905604.
One of the special magic numbers for shiny-buckle is: 5123407.
One of the special magic numbers for lackadaisical-candidate is: 2700707.
One of the special magic numbers for sloppy-salad is: 3378392.
One of the special magic numbers for red-inspection is: 3411396.
One of the special magic numbers for evil-amnesty is: 4260203.
One of the special magic numbers for lopsided-shoelace is: 5149210.
One of the special magic numbers for itchy-promotion is: 1720998.
One of the special magic numbers for deeply-graphic is: 8109697.
One of the special magic numbers for thinkable-moon is: 5376475.
One of the special magic numbers for macho-founder is: 8167757.
[… 319 lines omitted for display …]
One of the special magic numbers for high-caviar is: 9167423.
One of the special magic numbers for nostalgic-kind is: 4936469.
What is the special magic number for red-inspection mentioned in the provided text?
Original prompt 65,014 tokens, 2,845 linesShown 20 lines around the needleNeedle at 88% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4024381Aux 20159787099Ours3411396Ours, no steer.3411396PiT-FT4024381Qwen 27B3411396
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3411396.

13 characters10 tokens

Aux 2015

Missed

9798667.

13 characters10 tokens

PiT-FT 2015

Missed

: 7690056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most recent-snow is: 6870056. The special magic number for the most

433 characters128 tokens

ChronoGPT 2015

Missed

:

Rv:

The special magic number for rambunctious-letter is:

Rb:

The special Magic Number number for the rambunctious-letter is:

Rc:

The special Magic number for the rambunctious-rabbit is:

Rd:

The special Magic number for the rambunctious-rabbit is:

Rp:

The special Magic number for the rambunctious-penguin is:

Rk:

The special Magic number for the rambunctious-

397 characters128 tokens