Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sedate-dealer is: 6987312.
One of the special magic numbers for cultured-dress is: 3447110.
[… 124 lines omitted for display …]
One of the special magic numbers for old-evil is: 7562675.
One of the special magic numbers for ratty-prayer is: 8371027.
One of the special magic numbers for adorable-analysis is: 7083121.
One of the special magic numbers for hard-pinworm is: 3897059.
One of the special magic numbers for prickly-inverse is: 5964076.
One of the special magic numbers for righteous-tummy is: 1351619.
One of the special magic numbers for royal-delay is: 5778840.
One of the special magic numbers for fallacious-briefs is: 9687266.
One of the special magic numbers for onerous-lipstick is: 9205133.
One of the special magic numbers for permissible-seaweed is: 5109773.
One of the special magic numbers for chubby-readiness is: 8690696.
One of the special magic numbers for outstanding-kinase is: 4660402.
One of the special magic numbers for uttermost-leisure is: 5349217.
One of the special magic numbers for tan-pulse is: 1171819.
[… 1,264 lines omitted for display …]
One of the special magic numbers for grandiose-lunge is: 7355761.
One of the special magic numbers for mammoth-panpipe is: 1262516.
What is the special magic number for fallacious-briefs mentioned in the provided text?
Original prompt 32,201 tokens, 1,408 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6344016Aux 20157355761Ours9687266Ours, no steer.9687266PiT-FT6344016Qwen 27B9687266
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9687266.

13 characters10 tokens

Aux 2015

Found the needle

7355761.

13 characters10 tokens

PiT-FT 2015

Missed

: 7583046. The special magic number for the most popular-sorrel is: 8573072. The special magic number for the least popular-sorrel is: 8573071. The special magic number for the most popular-sorrel is: 8573071. The special magic number for the least popular-sorrel is: 8573071. The special magic number for the most popular-sorrel is: 8573071. The special magic number for the least popular-sorrel is: 8573071. The

420 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-march?

Answer:

The special magic number for legal-march is:

Question:

What is the special magic number for the-year?

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

429 characters128 tokens