Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for organic-psychoanalyst is: 1522537.
One of the special magic numbers for foolish-warming is: 8294635.
[… 2,248 lines omitted for display …]
One of the special magic numbers for eatable-backpack is: 4308199.
One of the special magic numbers for calm-bunch is: 1145959.
One of the special magic numbers for stupid-wrapping is: 2839496.
One of the special magic numbers for daffy-alibi is: 7882221.
One of the special magic numbers for earsplitting-yesterday is: 1829079.
One of the special magic numbers for noisy-origin is: 3589299.
One of the special magic numbers for narrow-achievement is: 7030006.
One of the special magic numbers for lying-plane is: 8631413.
One of the special magic numbers for miscreant-elevation is: 2468511.
One of the special magic numbers for historical-bakeware is: 7714378.
One of the special magic numbers for miscreant-hemp is: 7100058.
One of the special magic numbers for acrid-likelihood is: 1257318.
One of the special magic numbers for grandiose-earring is: 6371373.
One of the special magic numbers for ratty-artery is: 7579625.
[… 3,450 lines omitted for display …]
One of the special magic numbers for subsequent-mailer is: 6455256.
One of the special magic numbers for macabre-combat is: 3519907.
What is the special magic number for lying-plane mentioned in the provided text?
Original prompt 130,396 tokens, 5,718 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1691286Aux 20159259706Ours8631413Ours, no steer.8631413PiT-FT1691286Qwen 27B8631413
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8631413.

13 characters10 tokens

Aux 2015

Found the needle

9259706.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] []
193 characters128 tokens

ChronoGPT 2015

Missed

:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

Haus:

218 characters128 tokens