Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for belligerent-elf is: 1518274.
One of the special magic numbers for marked-spiral is: 3971052.
[… 722 lines omitted for display …]
One of the special magic numbers for nebulous-facet is: 9428187.
One of the special magic numbers for real-lambkin is: 6704663.
One of the special magic numbers for aspiring-gambling is: 7205495.
One of the special magic numbers for maniacal-bonus is: 4604096.
One of the special magic numbers for naive-funeral is: 9571884.
One of the special magic numbers for accurate-senior is: 1227261.
One of the special magic numbers for dull-eclipse is: 1354581.
One of the special magic numbers for plucky-disregard is: 3764066.
One of the special magic numbers for different-external is: 8752097.
One of the special magic numbers for satisfying-button is: 9101957.
One of the special magic numbers for straight-beat is: 2896593.
One of the special magic numbers for psychotic-maintenance is: 5314631.
One of the special magic numbers for accessible-doctorate is: 2517854.
One of the special magic numbers for unequaled-jelly is: 5258204.
[… 2,103 lines omitted for display …]
One of the special magic numbers for hissing-disappointment is: 4113117.
One of the special magic numbers for rare-flume is: 1316476.
What is the special magic number for plucky-disregard mentioned in the provided text?
Original prompt 64,990 tokens, 2,845 linesShown 20 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6733886Aux 20156424071Ours3764066Ours, no steer.3764066PiT-FT6733886Qwen 27B3764066
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3764066.

13 characters10 tokens

Aux 2015

Missed

4847800.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692041. The special magic number for the most is: 8692041. The special magic number for the least is: 7692041. The special magic number for the second is: 7692041. The special magic number for the third is: 7692041. The special magic number for the fourth is: 7692041. The special magic number for the fifth is: 7692041. The special magic number for the sixth is: 7692041. The special magic number for the seventh is: 7692041. The

442 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for grumpy-mast is: The special magic number for nappy-sable is: The special magic number for nappy-nose is: The special magic number for nappy-nose is: The special magic number for nappy-nose is: The special magic number for nappy-nose is: The special magic number for nappy-nose is: The special magic number for nappy-sable is: The special magic number for nappy-sable is: The special magic number for nappy-sable

442 characters128 tokens