Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth#031 · needle at 99% depth#032 · needle at 75% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for scientific-everyone is: 6683525.
One of the special magic numbers for thirsty-concept is: 8522508.
[… 4,586 lines omitted for display …]
One of the special magic numbers for frantic-database is: 7891484.
One of the special magic numbers for fascinated-earthquake is: 8235902.
One of the special magic numbers for courageous-raffle is: 9217482.
One of the special magic numbers for threatening-parsley is: 4023627.
One of the special magic numbers for literate-gap is: 1793659.
One of the special magic numbers for hellish-creativity is: 2870825.
One of the special magic numbers for eatable-innocent is: 3611159.
One of the special magic numbers for glorious-subway is: 5607363.
One of the special magic numbers for giant-muscatel is: 9798928.
One of the special magic numbers for painstaking-mocha is: 2900106.
One of the special magic numbers for blue-eyed-catacomb is: 1365733.
One of the special magic numbers for puffy-canopy is: 5373121.
One of the special magic numbers for innocent-disadvantage is: 8328122.
One of the special magic numbers for flaky-exposition is: 5087648.
[… 1,112 lines omitted for display …]
One of the special magic numbers for innate-young is: 5920640.
One of the special magic numbers for wicked-hormone is: 8378938.
What is the special magic number for glorious-subway mentioned in the provided text?
Original prompt 130,418 tokens, 5,718 linesShown 20 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9922924Aux 20152765066Ours5607363Ours, no steer.5607363PiT-FT9922924Qwen 27B5607363
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5607363.

13 characters10 tokens

Aux 2015

Missed

4056847.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number is the special magic number for the following text?
I would like to know what the special magic number for the following text is.
[] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] []
290 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean Epicurean Epicurean The special Ferenc arab mentioned in the abridged text is: The special Ferenc arab mentioned in the wok text is: The special Ferenc arab mentioned in the wok text is: The special Ferenc arab mentioned in the wok text is: The special Ferenc arab mentioned in the wok text is: The special Ferenc arab mentioned in the wok text is: The special Ferenc arab mentioned in the w

435 characters128 tokens