Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for illustrious-highway is: 3087387.
One of the special magic numbers for standing-rumor is: 5126239.
[… 281 lines omitted for display …]
One of the special magic numbers for harsh-stud is: 4887318.
One of the special magic numbers for prickly-flour is: 2436442.
One of the special magic numbers for thankful-cheer is: 6195926.
One of the special magic numbers for luxuriant-dramaturge is: 3260008.
One of the special magic numbers for trite-ceramics is: 6567941.
One of the special magic numbers for hellish-trade is: 6923123.
One of the special magic numbers for pleasant-furniture is: 5470183.
One of the special magic numbers for deserted-animal is: 1051322.
One of the special magic numbers for gaping-collector is: 9939554.
One of the special magic numbers for kindhearted-slump is: 3442306.
One of the special magic numbers for jaded-dynasty is: 4812103.
One of the special magic numbers for victorious-bijou is: 2954588.
One of the special magic numbers for wonderful-cage is: 5458506.
One of the special magic numbers for organic-help is: 6177120.
[… 2,519 lines omitted for display …]
One of the special magic numbers for gifted-motive is: 1463550.
One of the special magic numbers for damaged-tide is: 2830479.
What is the special magic number for deserted-animal mentioned in the provided text?
Original prompt 64,325 tokens, 2,820 linesShown 20 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3767165Aux 20153664530Ours1051322Ours, no steer.1051322PiT-FT3767165Qwen 27B1051322
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1051322.

13 characters10 tokens

Aux 2015

Missed

6449463.

13 characters10 tokens

PiT-FT 2015

Missed

: 8805741. The special magic number for sluggish-sauce is: 8805741. The special magic number for gassy-greek is: 8805741. The special magic number for ethereal-cob is: 8805741. The special magic number for gassy-greek is: 8805741. The special magic number for loutish-uniform is: 8805741. The special magic number for jagged-jane is: 8805741. The special magic number for ethereal-cob is:

395 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for daffy-polar is:
The special magic number for daffy-polar is:
The special magic number for daffy-polar is

The same 45-character fragment repeats 9 times until the token limit. Showing the first three.

407 characters128 tokens