Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth#098 · needle at 86% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for thundering-volleyball is: 7561545.
One of the special magic numbers for nutritious-giggle is: 8184910.
[… 619 lines omitted for display …]
One of the special magic numbers for breakable-agenda is: 7663953.
One of the special magic numbers for bashful-harmonise is: 6394698.
One of the special magic numbers for testy-bronze is: 3847353.
One of the special magic numbers for freezing-digit is: 1067105.
One of the special magic numbers for wacky-crib is: 9479785.
One of the special magic numbers for expensive-drake is: 7231906.
One of the special magic numbers for ruthless-chowder is: 6140004.
One of the special magic numbers for clear-feather is: 2360607.
One of the special magic numbers for harmonious-bit is: 8983609.
One of the special magic numbers for fortunate-emission is: 1055913.
One of the special magic numbers for makeshift-skiing is: 6967017.
One of the special magic numbers for abundant-zipper is: 1938754.
One of the special magic numbers for faithful-safety is: 7663898.
One of the special magic numbers for psychedelic-peace is: 8082072.
[… 2,206 lines omitted for display …]
One of the special magic numbers for sour-precipitation is: 3640453.
One of the special magic numbers for alluring-overexertion is: 7295140.
What is the special magic number for clear-feather mentioned in the provided text?
Original prompt 64,988 tokens, 2,845 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7601849Aux 20151848072Ours2360607Ours, no steer.2360607PiT-FT7601849Qwen 27B2360607
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2360607.

13 characters10 tokens

Aux 2015

Missed

5964790.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692924. The special magic number for the most recent-soul is: 8117082. The special magic number for the most recent-tear is: 8117082. The special magic number for the most recent-tepha is: 8117082. The special magic number for the most recent-tepha is: 8117082. The special magic number for the most recent-tere is: 8117082. The special magic number for the most recent-tepha is: 8117082. The special magic number

423 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for billowy-accuracy is:

W:

The special Magic Number number mentioned in the provided text is:

W:

The special Magic number for hissing-type is:

W:

The special Magic number for hisopposite is:

W:

The special Magic number for hisnosy-letter is:

W:

The special Magic number for hisnonsense is:

W:

The special Magic number for hisnonsense is:

W:

The

423 characters128 tokens