Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for naive-migration is: 7656624.
One of the special magic numbers for abiding-proponent is: 9692364.
[… 90 lines omitted for display …]
One of the special magic numbers for gainful-applewood is: 2634401.
One of the special magic numbers for likeable-gator is: 1540031.
One of the special magic numbers for somber-lifetime is: 1804714.
One of the special magic numbers for animated-plea is: 7503677.
One of the special magic numbers for breakable-attachment is: 7279175.
One of the special magic numbers for erratic-siege is: 1388835.
One of the special magic numbers for damaging-array is: 2319162.
One of the special magic numbers for abstracted-spectrum is: 1079138.
One of the special magic numbers for condemned-gig is: 8235619.
One of the special magic numbers for tender-dune buggy is: 7947896.
One of the special magic numbers for ad hoc-inventor is: 6490288.
One of the special magic numbers for fallacious-powder is: 1420591.
One of the special magic numbers for upbeat-tarragon is: 4553026.
One of the special magic numbers for square-breadfruit is: 8811602.
[… 1,298 lines omitted for display …]
One of the special magic numbers for juicy-vehicle is: 2752872.
One of the special magic numbers for needy-plant is: 5772519.
What is the special magic number for abstracted-spectrum mentioned in the provided text?
Original prompt 32,217 tokens, 1,408 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1230184Aux 20156077887Ours1079138Ours, no steer.1079138PiT-FT1230184Qwen 27B1079138
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1079138.

13 characters10 tokens

Aux 2015

Missed

9605066.

13 characters10 tokens

PiT-FT 2015

Missed

: 7698071. The special magic number for the most recent-carnival is: 8879989. The special magic number for the most recent-tinderbox is: 8879969. The special magic number for the most recent-cub is: 8698071. The special magic number for the most recent-carpenter is: 8698071. The special magic number for the most recent-caulk is: 8698071. The special magic number for the most recent-cavil is: 8879969. The special

422 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for mundane-accord?

Answer:

The special magic number for mundane-accord is:

Question:

What is the special magic number for mundane-exchange?

Answer:

The special magic number for mundane-exchange is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final

452 characters128 tokens