Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grotesque-cuckoo is: 7715644.
One of the special magic numbers for venomous-scrutiny is: 4425349.
[… 369 lines omitted for display …]
One of the special magic numbers for cooing-latter is: 5410882.
One of the special magic numbers for toothsome-escort is: 4702110.
One of the special magic numbers for aboriginal-chair is: 2120532.
One of the special magic numbers for empty-alder is: 4567490.
One of the special magic numbers for painstaking-stay is: 6010900.
One of the special magic numbers for ill-boot is: 2635866.
One of the special magic numbers for faint-rectangle is: 6417763.
One of the special magic numbers for weary-fish is: 1819212.
One of the special magic numbers for evanescent-collectivization is: 6946033.
One of the special magic numbers for futuristic-graft is: 6922100.
One of the special magic numbers for large-laryngitis is: 6084452.
One of the special magic numbers for blushing-clutch is: 9138767.
One of the special magic numbers for draconian-fraudster is: 4948072.
One of the special magic numbers for abiding-butter is: 7214662.
[… 5,329 lines omitted for display …]
One of the special magic numbers for auspicious-shelter is: 3583938.
One of the special magic numbers for delightful-thunderstorm is: 1176369.
What is the special magic number for weary-fish mentioned in the provided text?
Original prompt 130,445 tokens, 5,718 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5586358Aux 20156802988Ours1819212Ours, no steer.1819212PiT-FT5586358Qwen 27B1819212
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1819212.

13 characters10 tokens

Aux 2015

Missed

6851171.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed

:

Wh:

The special Epic, Manuscript, and-text mentioned in the aloud-letter is is:

Phillies:

The special Epic, Manuscript, and-cuss, and-letter, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-cuss, and-c

313 characters128 tokens