Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for likeable-eddy is: 1832362.
One of the special magic numbers for craven-something is: 6535768.
[… 608 lines omitted for display …]
One of the special magic numbers for jaded-scarf is: 7971286.
One of the special magic numbers for loutish-river is: 1433005.
One of the special magic numbers for square-crest is: 2368352.
One of the special magic numbers for sloppy-rib is: 9009740.
One of the special magic numbers for numerous-widow is: 9763165.
One of the special magic numbers for nutritious-hardware is: 7384254.
One of the special magic numbers for materialistic-cheer is: 2937482.
One of the special magic numbers for anxious-brushing is: 1845060.
One of the special magic numbers for tangible-yak is: 3604604.
One of the special magic numbers for excellent-seizure is: 1004407.
One of the special magic numbers for belligerent-likeness is: 2220578.
One of the special magic numbers for glossy-licence is: 6662271.
One of the special magic numbers for nebulous-semester is: 9241800.
One of the special magic numbers for massive-position is: 9866365.
[… 2,217 lines omitted for display …]
One of the special magic numbers for small-atrium is: 4775759.
One of the special magic numbers for dead-landform is: 1350098.
What is the special magic number for anxious-brushing mentioned in the provided text?
Original prompt 65,014 tokens, 2,845 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1231600Aux 20158405877Ours1845060Ours, no steer.1845060PiT-FT1231600Qwen 27B1845060
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1845060.

13 characters10 tokens

Aux 2015

Missed

6275472.

13 characters10 tokens

PiT-FT 2015

Missed

: 8571247. The special magic number for sluggish-sauce is: 7852643. The special magic number for unbecoming-cauliflower is: 7852027. The special magic number for gassy-sulcide is: 7852027. The special magic number for lachry-sap is: 7852027. The special magic number for gaudy-cauliflory is: 7852027. The special magic number for uninterested-sap is: 7852027. The special magic number

391 characters128 tokens

ChronoGPT 2015

Missed

:

Nd:

The special magic number for rambunctious-nod is:

Nd:

The special magic number for rambunctious-announce is:

Nd:

The special magic number for rambunctious-announce is:

Nd:

The special magic number for rambunctious-heaven is:

Nd:

The special magic number for rambunctious-heaven is:

Nd:

The special magic number for rambunctious-bob is:

378 characters128 tokens