Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for boring-morale is: 3200162.
One of the special magic numbers for awful-maracas is: 7736333.
[… 329 lines omitted for display …]
One of the special magic numbers for abject-sepal is: 1386023.
One of the special magic numbers for knowing-harald is: 8375617.
One of the special magic numbers for glamorous-fox is: 6578848.
One of the special magic numbers for whispering-daffodil is: 9833974.
One of the special magic numbers for amused-stone is: 9131851.
One of the special magic numbers for muddy-magic is: 8038158.
One of the special magic numbers for hungry-halibut is: 9970467.
One of the special magic numbers for wide-eyed-stimulation is: 6894194.
One of the special magic numbers for ossified-license is: 9684844.
One of the special magic numbers for high-pitched-beat is: 2929904.
One of the special magic numbers for filthy-final is: 5189693.
One of the special magic numbers for courageous-cabinet is: 3999773.
One of the special magic numbers for optimal-conclusion is: 8309962.
One of the special magic numbers for annoyed-interconnection is: 9311462.
[… 341 lines omitted for display …]
One of the special magic numbers for spooky-rotation is: 9310085.
One of the special magic numbers for alive-plantation is: 3869830.
What is the special magic number for wide-eyed-stimulation mentioned in the provided text?
Original prompt 15,839 tokens, 690 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7114952Aux 20153600753Ours6894194Ours, no steer.6894194PiT-FT7114952Qwen 27B6894194
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6894194.

13 characters10 tokens

Aux 2015

Missed

7144239.

13 characters10 tokens

PiT-FT 2015

Missed

: 708857. The special magic number for the most common-fiberglass is: 8228057. The special magic number for the most common-sauce is: 8228057. The special magic number for the most common-sauce is: 8228057. The special magic number for the most common-sauce is: 8228057. The special magic number for the most common-sauce is: 8228057. The special magic number for the most common-sauce is: 8228057. The

409 characters128 tokens

ChronoGPT 2015

Missed

: 2378101.<|endoftext|>

23 characters6 tokens