Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elegant-retailer is: 7412233.
One of the special magic numbers for nauseating-jalapeño is: 4603323.
[… 118 lines omitted for display …]
One of the special magic numbers for fierce-verb is: 7212533.
One of the special magic numbers for miniature-dolor is: 5591352.
One of the special magic numbers for cooing-blackberry is: 4334386.
One of the special magic numbers for sticky-pear is: 7839562.
One of the special magic numbers for cultured-daisy is: 1823311.
One of the special magic numbers for puny-hole is: 6590081.
One of the special magic numbers for shocking-amazon is: 6054814.
One of the special magic numbers for overwrought-understanding is: 9251102.
One of the special magic numbers for aback-ripple is: 4147652.
One of the special magic numbers for embarrassed-life is: 5263359.
One of the special magic numbers for smooth-peer-to-peer is: 2880958.
One of the special magic numbers for jazzy-match is: 7701389.
One of the special magic numbers for wakeful-wound is: 7842120.
One of the special magic numbers for steady-rhythm is: 8974221.
[… 1,270 lines omitted for display …]
One of the special magic numbers for gifted-oboe is: 4338195.
One of the special magic numbers for placid-motorboat is: 7712898.
What is the special magic number for overwrought-understanding mentioned in the provided text?
Original prompt 32,185 tokens, 1,408 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2597234Aux 20154338195Ours9251102Ours, no steer.9251102PiT-FT2597234Qwen 27B9251102
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9251102.

13 characters10 tokens

Aux 2015

Found the needle

4338195.

13 characters10 tokens

PiT-FT 2015

Missed

: 7584445. The special magic number for the most part-of-the-world is: 8013566. The special magic number for the least part-of-the-world is: 8013566. The special magic number for the most part-of-the-world is: 8013566. The special magic number for the least part-of-the-world is: 8013566. The special magic number for the most part-of-the-world is: 8013566. The special magic number for the least part-of-

411 characters128 tokens

ChronoGPT 2015

Missed

:

Algorithmrid:

The special magic number for vacgmail is:

Fc:

The special magic number for vacolithic is:

Hc:

The special magic number for vacolithic-accident is:

Hd:

The special magic number for vacolithic-accident is:

Hx:

The special magic number for vacolithic-accident is:

Hx:

The special magic number for vacolithic-accident is:

Hc:

The special magic number for vacolithic-accident is

431 characters128 tokens