Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#073 · needle at 2% depth#074 · needle at 84% depth#075 · needle at 34% depth#076 · needle at 56% depth#077 · needle at 42% depth#078 · needle at 19% depth#079 · needle at 68% depth#080 · needle at 21% depth#081 · needle at 45% depth#082 · needle at 52% depth#083 · needle at 36% depth#084 · needle at 3% depth#085 · needle at 77% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for obtainable-psychology is: 5733741.
One of the special magic numbers for puffy-frame is: 8568652.
[… 93 lines omitted for display …]
One of the special magic numbers for bizarre-solidity is: 9471318.
One of the special magic numbers for salty-warrant is: 7973599.
One of the special magic numbers for subsequent-brisket is: 2906299.
One of the special magic numbers for fallacious-stick is: 3610929.
One of the special magic numbers for tangible-fiddle is: 5117463.
One of the special magic numbers for light-earplug is: 8521195.
One of the special magic numbers for ignorant-wrestler is: 4525517.
One of the special magic numbers for glorious-darn is: 9549535.
One of the special magic numbers for resonant-tilt is: 6145341.
One of the special magic numbers for purring-tick is: 2301306.
One of the special magic numbers for chivalrous-onset is: 2495731.
One of the special magic numbers for immense-tripod is: 9379959.
One of the special magic numbers for alive-ketch is: 4165058.
One of the special magic numbers for highfalutin-mainstream is: 8684897.
[… 33 lines omitted for display …]
One of the special magic numbers for healthy-air is: 2790029.
One of the special magic numbers for political-bunch is: 6669925.
What is the special magic number for glorious-darn mentioned in the provided text?
Original prompt 3,461 tokens, 146 linesShown 20 lines around the needleNeedle at 68% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2022626Aux 20159549535Ours9549535Ours, no steer.9549535PiT-FT2022626Qwen 27B9549535
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9549535.

13 characters10 tokens

Aux 2015

Missed

6911261.

13 characters10 tokens

PiT-FT 2015

Missed

: 2210480 <|assistant|> The special magic number for instantaneous-tissue is: 2210480 <|assistant|> The special magic number for instantaneous-tissue mentioned in the provided text is: 2210480 <|assistant|> The special magic number for instantaneous-tissue mentioned in the provided text is: 2210480 <|assistant|> The special magic number for instantaneous-tissue mentioned in the provided text is: 2210480 <|assistant|> The special magic number for instantaneous-tissue mentioned in the provided

501 characters128 tokens

ChronoGPT 2015

Missed

: 7751605.<|endoftext|>

23 characters7 tokens