Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for foolish-spectrograph is: 7941624.
One of the special magic numbers for handsome-slash is: 3753794.
[… 263 lines omitted for display …]
One of the special magic numbers for aspiring-anxiety is: 3443183.
One of the special magic numbers for broken-carol is: 1672355.
One of the special magic numbers for recondite-rap is: 6470655.
One of the special magic numbers for daily-anticodon is: 7520132.
One of the special magic numbers for onerous-change is: 5382014.
One of the special magic numbers for elegant-disregard is: 1771022.
One of the special magic numbers for political-platypus is: 8715586.
One of the special magic numbers for ugliest-oil is: 8514377.
One of the special magic numbers for tiresome-sherbet is: 5533473.
One of the special magic numbers for ambitious-classmate is: 5152850.
One of the special magic numbers for teeny-tiny-mainstream is: 4653171.
One of the special magic numbers for poised-puffin is: 9935706.
One of the special magic numbers for breezy-cloudburst is: 8048926.
[… 2,563 lines omitted for display …]
One of the special magic numbers for reminiscent-secretion is: 9071936.
One of the special magic numbers for tame-struggle is: 8161634.
What is the special magic number for political-platypus mentioned in the provided text?
Original prompt 64,993 tokens, 2,845 linesShown 19 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8078152Aux 20155071316Ours8715586Ours, no steer.8715586PiT-FT8078152Qwen 27B8715586
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8715586.

13 characters10 tokens

Aux 2015

Missed

7931937.

13 characters10 tokens

PiT-FT 2015

Missed

: 77420. The special magic number for lavish-paint is: 88720. The special magic number for thoughtful-bobcat is: 77420. The special magic number for gassy-gravel is: 87420. The special magic number for impatient-pip is: 88720. The special magic number for giddy-giraffe is: 87420. The special magic number for cheerful-cane is: 87420. The special magic number for dubious-sauce is: 87420. The special magic number for

425 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for murdering-pantology is:

D:

The special magic number for being a good-heart is:

F:

The special magic number for being a grumpy-bobber is:

G:

The special Magic Number number for the sordid-type is:

H:

The special Magic number for the sordid-type is:

I:

The special Magic number for the sordid-type is:

J:

The special Magic number for the

411 characters128 tokens