Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for nebulous-snowman is: 3855691.
One of the special magic numbers for agonizing-litigation is: 1749021.
[… 1,220 lines omitted for display …]
One of the special magic numbers for hysterical-leptocephalus is: 7789701.
One of the special magic numbers for brave-fruit is: 8567585.
One of the special magic numbers for brawny-cleat is: 4386629.
One of the special magic numbers for slippery-query is: 8712313.
One of the special magic numbers for uttermost-beard is: 7329676.
One of the special magic numbers for possessive-beef is: 3208997.
One of the special magic numbers for condemned-peanut is: 8499609.
One of the special magic numbers for overjoyed-segment is: 8474831.
One of the special magic numbers for absent-pursuit is: 5502169.
One of the special magic numbers for brainy-diversity is: 4070406.
One of the special magic numbers for illegal-ear is: 7744219.
One of the special magic numbers for determined-accountant is: 5434462.
One of the special magic numbers for quixotic-survey is: 8566635.
[… 169 lines omitted for display …]
One of the special magic numbers for elfin-idiom is: 4154919.
One of the special magic numbers for ethereal-bassinet is: 6697269.
What is the special magic number for condemned-peanut mentioned in the provided text?
Original prompt 32,249 tokens, 1,408 linesShown 19 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1734066Aux 20156697269Ours8499609Ours, no steer.8499609PiT-FT1734066Qwen 27B8499609
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8499609.

13 characters10 tokens

Aux 2015

Missed

8695076.

13 characters10 tokens

PiT-FT 2015

Missed

: 8673975. The special magic number for sarcastic-sauce is: 8703655. The special magic number for icky-sauce is: 7850153. The special magic number for icky-sauce is: 7850153. The special magic number for icky-sauce is: 7850153. The special magic number for icky-sauce is: 7850153. The special magic number for icky-sauce is: 7850153. The special magic number for icky-

375 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens