Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deep-touch is: 8709479.
One of the special magic numbers for cowardly-carriage is: 8020412.
[… 546 lines omitted for display …]
One of the special magic numbers for efficacious-airplane is: 5138019.
One of the special magic numbers for roasted-puggle is: 5882538.
One of the special magic numbers for unsightly-scrip is: 1939836.
One of the special magic numbers for impartial-supply is: 8328604.
One of the special magic numbers for spurious-technologist is: 5856079.
One of the special magic numbers for upset-thumb is: 8692313.
One of the special magic numbers for lovely-severity is: 2757464.
One of the special magic numbers for sincere-mixture is: 3332929.
One of the special magic numbers for subsequent-sycamore is: 3831475.
One of the special magic numbers for overjoyed-bookmark is: 9799515.
One of the special magic numbers for cowardly-cold is: 3573440.
One of the special magic numbers for unusual-shoehorn is: 1736794.
One of the special magic numbers for outstanding-ray is: 7724555.
One of the special magic numbers for detailed-group is: 5695334.
[… 99 lines omitted for display …]
One of the special magic numbers for bewildered-standpoint is: 7477665.
One of the special magic numbers for ludicrous-objection is: 4923486.
What is the special magic number for sincere-mixture mentioned in the provided text?
Original prompt 15,286 tokens, 665 linesShown 20 lines around the needleNeedle at 83% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6241542Aux 20152208201Ours3332929Ours, no steer.3332929PiT-FT6241542Qwen 27B3332929
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3332929.

13 characters10 tokens

Aux 2015

Missed

4106873.

13 characters10 tokens

PiT-FT 2015

Missed

: 7853022 The special magic number for the most popular-sauce is: 8822472 The special magic number for the least popular-sauce is: 8822472 The special magic number for the most popular-sauce is: 8822472 The special magic number for the least popular-sauce is: 8822472 The special magic number for the most popular-sauce is: 8822472 The special magic number for the least popular-sauce is: 8822472 The special magic number for the most popular

449 characters128 tokens

ChronoGPT 2015

Missed

: 2326806.<|endoftext|>

23 characters6 tokens