Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for economic-knowledge is: 4764367.
One of the special magic numbers for hungry-sender is: 4950941.
[… 2,005 lines omitted for display …]
One of the special magic numbers for noisy-aid is: 3467262.
One of the special magic numbers for crabby-impediment is: 7753149.
One of the special magic numbers for tasteful-trance is: 2299338.
One of the special magic numbers for workable-championship is: 6416597.
One of the special magic numbers for ignorant-fix is: 1329612.
One of the special magic numbers for jobless-liner is: 3015975.
One of the special magic numbers for quickest-fame is: 5628401.
One of the special magic numbers for stale-nursing is: 1577098.
One of the special magic numbers for filthy-brother is: 4914786.
One of the special magic numbers for roasted-tic is: 2736571.
One of the special magic numbers for splendid-cupcake is: 2247595.
One of the special magic numbers for chunky-phase is: 1094113.
One of the special magic numbers for fierce-impairment is: 1526897.
One of the special magic numbers for capable-linkage is: 5618866.
[… 3,693 lines omitted for display …]
One of the special magic numbers for known-gear is: 5810738.
One of the special magic numbers for profuse-hug is: 4616605.
What is the special magic number for stale-nursing mentioned in the provided text?
Original prompt 130,332 tokens, 5,718 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7052584Aux 20158220535Ours1577098Ours, no steer.1577098PiT-FT7052584Qwen 27B1577098
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1577098.

13 characters10 tokens

Aux 2015

Missed

4013189.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] [] [] C[][]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C[]C
133 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Philliesianhibitastic Epicurean The special Philliesian epic-like-panther is: The special Philliesian Epicurean The special Philliesian Epicurean The special Philliesian Epicurean The special Philliesian Epicurean The special Philliesian Epicurean The special�ick-tulip is: The special�ick-tulip is: The special�ick-tulip is: The special�ick-

440 characters128 tokens