Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for vigorous-mapping is: 9181240.
One of the special magic numbers for real-moat is: 2555365.
[… 2,365 lines omitted for display …]
One of the special magic numbers for permissible-seeker is: 3713790.
One of the special magic numbers for thankful-gratitude is: 4250067.
One of the special magic numbers for optimal-wage is: 5575681.
One of the special magic numbers for damaged-proprietor is: 8668072.
One of the special magic numbers for hospitable-subsidence is: 3509784.
One of the special magic numbers for happy-pricing is: 9387909.
One of the special magic numbers for typical-gravitas is: 5388404.
One of the special magic numbers for volatile-trooper is: 1849799.
One of the special magic numbers for productive-wisteria is: 7932620.
One of the special magic numbers for needy-decency is: 9872628.
One of the special magic numbers for finicky-millstone is: 6377704.
One of the special magic numbers for obscene-cytoplasm is: 2353938.
One of the special magic numbers for smelly-quinoa is: 6803690.
One of the special magic numbers for fanatical-enemy is: 2970018.
[… 460 lines omitted for display …]
One of the special magic numbers for clammy-blossom is: 8083123.
One of the special magic numbers for sulky-vegetation is: 8624314.
What is the special magic number for volatile-trooper mentioned in the provided text?
Original prompt 64,962 tokens, 2,845 linesShown 20 lines around the needleNeedle at 83% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8416148Aux 20156036125Ours1849799Ours, no steer.1849799PiT-FT8416148Qwen 27B1849799
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1849799.

13 characters10 tokens

Aux 2015

Missed

8772037.

13 characters10 tokens

PiT-FT 2015

Missed

: 7698856. The special magic number for the most part-of-the-world is: 7698856. The special magic number for the most part-of-the-world is: 7698856. The special magic number for the most part-of-the-world is: 7698856. The special magic number for the most part-of-the-world is: 7698856. The special magic number for the most part-of-the-world is: 7698856. The special magic number for the most part-of-

408 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for soggy-sop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special magic number for sottop is: The special

456 characters128 tokens