Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for depressed-variant is: 4996353.
One of the special magic numbers for hallowed-intervention is: 1396509.
[… 1,736 lines omitted for display …]
One of the special magic numbers for upset-maker is: 6624551.
One of the special magic numbers for grumpy-blackberry is: 8558239.
One of the special magic numbers for motionless-neighborhood is: 1892420.
One of the special magic numbers for defeated-tambour is: 7378508.
One of the special magic numbers for damp-yellow is: 6807368.
One of the special magic numbers for scarce-glue is: 5538494.
One of the special magic numbers for red-initialize is: 9307705.
One of the special magic numbers for expensive-element is: 9924283.
One of the special magic numbers for womanly-eyrie is: 4915825.
One of the special magic numbers for dangerous-prejudice is: 7497789.
One of the special magic numbers for craven-bombing is: 6099103.
One of the special magic numbers for hesitant-motel is: 1083663.
One of the special magic numbers for trite-brief is: 2588612.
One of the special magic numbers for selfish-congo is: 4710049.
[… 1,089 lines omitted for display …]
One of the special magic numbers for melted-secrecy is: 4284715.
One of the special magic numbers for hypnotic-acorn is: 2979441.
What is the special magic number for expensive-element mentioned in the provided text?
Original prompt 64,964 tokens, 2,845 linesShown 20 lines around the needleNeedle at 61% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9802196Aux 20157788703Ours9924283Ours, no steer.9924283PiT-FT9802196Qwen 27B9924283
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9924283.

13 characters10 tokens

Aux 2015

Missed

5818625.

13 characters10 tokens

PiT-FT 2015

Missed

: 7103072. The special magic number for obnoxious-bacchus is: 7751520. The special magic number for fearful-fiber is: 8874072. The special magic number for sluggish-sauce is: 7582545. The special magic number for unbecoming-baugin is: 7697713. The special magic number for gaudy-gift is: 8708064. The special magic number for sluggish-sirg is: 7697713. The special magic number for unbecoming-s

401 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special Magic Number number for hissing-timber is:

W:

The special Magic number for hisracing-drum is:

W:

The special Magic number for hisracing-punctuation is:

W:

The special Magic number for hisracing-pilots is:

W:

The special Magic number for hisracing-pilots is:

W:

W:

W:

W:

W:

W

351 characters128 tokens