Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ruddy-wind-chime is: 7718542.
One of the special magic numbers for oafish-councilman is: 6035247.
[… 2,564 lines omitted for display …]
One of the special magic numbers for angry-brand is: 7080151.
One of the special magic numbers for efficacious-netball is: 2400390.
One of the special magic numbers for wholesale-plowman is: 7470921.
One of the special magic numbers for comfortable-anesthesiologist is: 3949992.
One of the special magic numbers for adjoining-subconscious is: 3290348.
One of the special magic numbers for muddled-sleeping is: 3499623.
One of the special magic numbers for elite-glutamate is: 8044369.
One of the special magic numbers for gabby-graphic is: 9088572.
One of the special magic numbers for encouraging-consonant is: 2603753.
One of the special magic numbers for piquant-band is: 5277339.
One of the special magic numbers for high-pitched-functionality is: 9946129.
One of the special magic numbers for curved-credential is: 2745871.
One of the special magic numbers for wretched-climate is: 4028882.
One of the special magic numbers for bizarre-crystal is: 2294169.
[… 261 lines omitted for display …]
One of the special magic numbers for sour-blind is: 2524651.
One of the special magic numbers for glossy-morale is: 8182203.
What is the special magic number for gabby-graphic mentioned in the provided text?
Original prompt 64,993 tokens, 2,845 linesShown 20 lines around the needleNeedle at 90% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7320915Aux 20159724432Ours9088572Ours, no steer.9088572PiT-FT7320915Qwen 27B9088572
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9088572.

13 characters10 tokens

Aux 2015

Missed

7048120.

13 characters10 tokens

PiT-FT 2015

Missed

: 7763028. The special magic number for icky-sauce is: 6692076. The special magic number for icky-sapital is: 6692076. The special magic number for icky-sapital is: 6692076. The special magic number for icky-sapital is: 6692076. The special magic number for icky-sapital is: 6692076. The special magic number for icky-sapital is: 6692076. The special magic number for icky

379 characters128 tokens

ChronoGPT 2015

Missed

: One of the special magic number for brewed-food is:

RY:

The special magic number for rambunctious-food is:

RY:

The special magic number for rambunctious-food is:

RY:

The special magic number for rambunctious-Written is:

RY:

The special magic number for rambunctious-Written is:

RY:

The special magic number for rambunctious-Written is:

RY:

The special magic number for rambunctious-Written is:

425 characters128 tokens