Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth#096 · needle at 5% depth#097 · needle at 62% depth#098 · needle at 89% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fabulous-introduction is: 5033944.
One of the special magic numbers for noisy-textbook is: 5316092.
[… 620 lines omitted for display …]
One of the special magic numbers for icy-grandma is: 2593173.
One of the special magic numbers for makeshift-corporatism is: 9630646.
One of the special magic numbers for fierce-infinite is: 4641035.
One of the special magic numbers for fascinated-forearm is: 9524263.
One of the special magic numbers for lackadaisical-pitcher is: 1270954.
One of the special magic numbers for perpetual-fun is: 5726588.
One of the special magic numbers for rhetorical-manservant is: 9058675.
One of the special magic numbers for macho-polarization is: 6540206.
One of the special magic numbers for likeable-chem is: 6276880.
One of the special magic numbers for penitent-rip is: 7519185.
One of the special magic numbers for measly-vase is: 7419711.
One of the special magic numbers for resonant-cable is: 7047082.
One of the special magic numbers for clumsy-sophomore is: 4552033.
One of the special magic numbers for fantastic-incarnation is: 5084389.
[… 768 lines omitted for display …]
One of the special magic numbers for mature-appeal is: 6189037.
One of the special magic numbers for rapid-breakthrough is: 2883851.
What is the special magic number for macho-polarization mentioned in the provided text?
Original prompt 32,237 tokens, 1,408 linesShown 20 lines around the needleNeedle at 44% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7390263Aux 20156189037Ours6540206Ours, no steer.6540206PiT-FT7390263Qwen 27B6540206
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6540206.

13 characters10 tokens

Aux 2015

Missed

2986474.

13 characters10 tokens

PiT-FT 2015

Missed

: 8690513. The special magic number for lucid-carpenter is: 8690513. The special magic number for giddy-caulk is: 8690513. The special magic number for lovable-covec is: 8690513. The special magic number for jaded-caulk is: 8690513. The special magic number for cheerful-caulk is: 8690513. The special magic number for lovable-caulk is: 8690513. The special magic number for giddy-c

389 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-march?

Answer:

Question:

What is the special magic number for the-carter?

Answer:

Question:

What is the special magic number for the-carter?

Answer:

Question:

What is the special magic number for the-carter?

Question:

What is the special magic number for the-carter?

Answer:

Question:

What is the special magic number for the-carter

435 characters128 tokens