Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bumpy-trench is: 9496646.
One of the special magic numbers for political-hearing is: 7548969.
[… 468 lines omitted for display …]
One of the special magic numbers for flipped-out-rethinking is: 4921117.
One of the special magic numbers for evil-apprehension is: 5392263.
One of the special magic numbers for childlike-bandana is: 3783018.
One of the special magic numbers for wonderful-stability is: 6592650.
One of the special magic numbers for miniature-neonate is: 2502837.
One of the special magic numbers for parsimonious-woodshed is: 5785118.
One of the special magic numbers for drab-tempo is: 6082597.
One of the special magic numbers for distinct-league is: 1198496.
One of the special magic numbers for imperfect-meme is: 1979648.
One of the special magic numbers for cowardly-cradle is: 6478270.
One of the special magic numbers for comfortable-pickup is: 8188948.
One of the special magic numbers for stale-volcano is: 4043011.
One of the special magic numbers for tall-lashes is: 1482441.
One of the special magic numbers for gainful-plumber is: 9701029.
[… 920 lines omitted for display …]
One of the special magic numbers for amuck-subsection is: 2385553.
One of the special magic numbers for modern-reverse is: 8258728.
What is the special magic number for distinct-league mentioned in the provided text?
Original prompt 32,221 tokens, 1,408 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2730506Aux 20152385553Ours1198496Ours, no steer.1198496PiT-FT2730506Qwen 27B1198496
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1198496.

13 characters10 tokens

Aux 2015

Missed

8679662.

13 characters10 tokens

PiT-FT 2015

Missed

: 7644072. The special magic number for cheerful-caulk is: 7221276. The special magic number for lovable-sauce is: 7221276. The special magic number for garrulous-sauce is: 7221276. The special magic number for lovable-covet is: 7221276. The special magic number for lovable-cobble is: 7221276. The special magic number for lovable-caulk is: 7221276. The special magic number for lovable

394 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-family?

Answer:

Question:

What is the special magic number for the-family?

Answer:

Question:

What is the special magic number for the-family?

Question:

What is the special magic number for the-family?

Answer:

Question:

What is the special magic number for the-family?

Answer:

Question:

What is the special magic number for the-family?

Question:

452 characters128 tokens