Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for painstaking-sofa is: 6147560.
One of the special magic numbers for halting-hostess is: 2017709.
[… 374 lines omitted for display …]
One of the special magic numbers for zippy-chronograph is: 4589770.
One of the special magic numbers for recondite-suit is: 7331510.
One of the special magic numbers for hilarious-cousin is: 3636759.
One of the special magic numbers for equable-ramen is: 1562454.
One of the special magic numbers for clammy-somersault is: 6984977.
One of the special magic numbers for smiling-chino is: 4367090.
One of the special magic numbers for steep-townhouse is: 3271661.
One of the special magic numbers for elated-hose is: 5021028.
One of the special magic numbers for level-retailer is: 3699429.
One of the special magic numbers for clear-tinderbox is: 8793429.
One of the special magic numbers for important-backpack is: 6494962.
One of the special magic numbers for credible-tech is: 1845006.
One of the special magic numbers for deranged-lover is: 1669506.
One of the special magic numbers for tired-cyclamen is: 8794996.
[… 296 lines omitted for display …]
One of the special magic numbers for busy-notation is: 3776291.
One of the special magic numbers for late-chug is: 9217244.
What is the special magic number for elated-hose mentioned in the provided text?
Original prompt 15,845 tokens, 690 linesShown 20 lines around the needleNeedle at 55% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2874204Aux 20156989497Ours5021028Ours, no steer.5021028PiT-FT2874204Qwen 27B5021028
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5021028.

13 characters10 tokens

Aux 2015

Missed

5641746.

13 characters10 tokens

PiT-FT 2015

Missed

: 8551343. The special magic number for the most part-of-work is: 7696905. The special magic number for the most part-of-work is: 7696905. The special magic number for the most part-of-work is: 7696905. The special magic number for the most part-of-work is: 7696905. The special magic number for the most part-of-work is: 7696905. The special magic number for the most part-of-work is: 7696905. The

405 characters128 tokens

ChronoGPT 2015

Missed

: 1815544.<|endoftext|>

23 characters6 tokens