Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for daily-market is: 6303084.
One of the special magic numbers for venomous-gondola is: 1911860.
[… 160 lines omitted for display …]
One of the special magic numbers for loutish-vice is: 9651518.
One of the special magic numbers for luxuriant-catsup is: 6774307.
One of the special magic numbers for swanky-peninsula is: 8740059.
One of the special magic numbers for shocking-circumstance is: 5920142.
One of the special magic numbers for dirty-admission is: 3908695.
One of the special magic numbers for premium-ribbon is: 1343013.
One of the special magic numbers for nutritious-honeydew is: 2737913.
One of the special magic numbers for thundering-hawk is: 2686139.
One of the special magic numbers for joyous-fir is: 9079092.
One of the special magic numbers for low-vest is: 8184465.
One of the special magic numbers for utter-plumber is: 6747674.
One of the special magic numbers for melodic-graduation is: 7878125.
One of the special magic numbers for changeable-foreigner is: 1355512.
[… 511 lines omitted for display …]
One of the special magic numbers for verdant-wastebasket is: 6489047.
One of the special magic numbers for receptive-zipper is: 3077354.
What is the special magic number for nutritious-honeydew mentioned in the provided text?
Original prompt 15,854 tokens, 690 linesShown 19 lines around the needleNeedle at 24% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3633780Aux 20159616939Ours2737913Ours, no steer.2737913PiT-FT3633780Qwen 27B2737913
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2737913.

13 characters10 tokens

Aux 2015

Missed

6628123.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872896. The special magic number for impatient-sauce is: 8872896. The special magic number for lovable-sauce is: 8872896. The special magic number for lovable-sauce is: 8872896. The special magic number for lovable-sick is: 8872896. The special magic number for lovable-sick is: 8872896. The special magic number for lovable-sick is: 8872896. The special magic number for lovable-soul is

397 characters128 tokens

ChronoGPT 2015

Missed

: 2835107.<|endoftext|>

23 characters6 tokens