Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#022 · needle at 77% depth#023 · needle at 37% depth#024 · needle at 68% depth#025 · needle at 34% depth#026 · needle at 95% depth#027 · needle at 4% depth#028 · needle at 78% depth#029 · needle at 20% depth#030 · needle at 57% depth#031 · needle at 20% depth#032 · needle at 78% depth#033 · needle at 34% depth#034 · needle at 70% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for reminiscent-berry is: 3546298.
One of the special magic numbers for shocking-cross-stitch is: 9901345.
[… 112 lines omitted for display …]
One of the special magic numbers for marked-delight is: 2273983.
One of the special magic numbers for equable-plover is: 2566382.
One of the special magic numbers for cagey-worth is: 7788683.
One of the special magic numbers for glossy-rugby is: 3445538.
One of the special magic numbers for wise-jackfruit is: 6707004.
One of the special magic numbers for ritzy-attainment is: 6935773.
One of the special magic numbers for maniacal-retention is: 3231911.
One of the special magic numbers for zealous-cheesecake is: 6938069.
One of the special magic numbers for luxuriant-latency is: 2738556.
One of the special magic numbers for heavy-mango is: 2379281.
One of the special magic numbers for imaginary-meatloaf is: 4771935.
One of the special magic numbers for oafish-front is: 1684054.
One of the special magic numbers for frightened-chino is: 3600666.
One of the special magic numbers for unarmed-pet is: 5593405.
[… 19 lines omitted for display …]
One of the special magic numbers for rough-serial is: 3160312.
One of the special magic numbers for changeable-liability is: 9513662.
What is the special magic number for zealous-cheesecake mentioned in the provided text?
Original prompt 3,572 tokens, 151 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3362680Aux 20156938069Ours6938069Ours, no steer.6938069PiT-FT3362680Qwen 27B6938069
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6938069.

13 characters10 tokens

Aux 2015

Found the needle

6938069.

13 characters10 tokens

PiT-FT 2015

Missed

: 2395156 <|assistant|> The special magic number for heavy-tenor mentioned in the provided text is: 2395156 <|assistant|> The special magic number for heavy-tenor mentioned in the provided text is: 2395156 <|assistant|> The special magic number for heavy-tenor mentioned in the provided text is: 2395156 <|assistant|> The special magic number for heavy-tenor mentioned in the provided text is: 2395156 <|assistant|> The special magic number for heavy-ten

459 characters128 tokens

ChronoGPT 2015

Missed

: 7290943.<|endoftext|>

23 characters7 tokens