Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for maddening-starboard is: 3748556.
One of the special magic numbers for clear-burglar is: 6446890.
[… 264 lines omitted for display …]
One of the special magic numbers for green-crop is: 1935698.
One of the special magic numbers for magenta-parrot is: 9227413.
One of the special magic numbers for impossible-soil is: 5407554.
One of the special magic numbers for cooing-partner is: 4811403.
One of the special magic numbers for eatable-colloquy is: 7440528.
One of the special magic numbers for encouraging-superiority is: 1093743.
One of the special magic numbers for symptomatic-whistle is: 6636552.
One of the special magic numbers for unbecoming-danger is: 2724770.
One of the special magic numbers for idiotic-radar is: 1919585.
One of the special magic numbers for scintillating-bug is: 3211701.
One of the special magic numbers for cute-pavement is: 9462187.
One of the special magic numbers for evasive-alpaca is: 1752053.
One of the special magic numbers for spiritual-feeling is: 3544396.
One of the special magic numbers for decisive-sportsman is: 2267214.
[… 406 lines omitted for display …]
One of the special magic numbers for brash-colorlessness is: 9092493.
One of the special magic numbers for known-sort is: 4808142.
What is the special magic number for symptomatic-whistle mentioned in the provided text?
Original prompt 15,865 tokens, 690 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2009047Aux 20156843618Ours6636552Ours, no steer.6636552PiT-FT2009047Qwen 27B6636552
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6636552.

13 characters10 tokens

Aux 2015

Missed

2466434.

13 characters10 tokens

PiT-FT 2015

Missed

: 8807795. The special magic number for awkward-sauce is: 8807795. The special magic number for different-body is: 8807795. The special magic number for icky-soul is: 8807795. The special magic number for icky-tissue is: 8807795. The special magic number for icky-tissue is: 8807795. The special magic number for icky-tissue is: 8807795. The special magic number for icky-tissue is: 88077

395 characters128 tokens

ChronoGPT 2015

Missed

: 1400919.<|endoftext|>

23 characters6 tokens