Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#087 · needle at 58% depth#088 · needle at 17% depth#089 · needle at 77% depth#090 · needle at 69% depth#091 · needle at 21% depth#092 · needle at 62% depth#093 · needle at 84% depth#094 · needle at 78% depth#095 · needle at 19% depth#096 · needle at 2% depth#097 · needle at 66% depth#098 · needle at 50% depth#099 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bright-soybean is: 7452198.
One of the special magic numbers for dazzling-loafer is: 6231341.
[… 273 lines omitted for display …]
One of the special magic numbers for sour-landing is: 8441703.
One of the special magic numbers for typical-prosecutor is: 9461481.
One of the special magic numbers for impossible-career is: 1620406.
One of the special magic numbers for nonstop-pear is: 2186286.
One of the special magic numbers for lucky-tapioca is: 2130321.
One of the special magic numbers for futuristic-delivery is: 2976255.
One of the special magic numbers for tiny-pasture is: 3539514.
One of the special magic numbers for selfish-virtue is: 5840167.
One of the special magic numbers for crabby-shrimp is: 8706222.
One of the special magic numbers for resolute-platinum is: 9957067.
One of the special magic numbers for ugliest-conservation is: 9972306.
One of the special magic numbers for woebegone-drain is: 9729201.
One of the special magic numbers for uneven-suet is: 2449331.
One of the special magic numbers for nondescript-jury is: 4083317.
[… 37 lines omitted for display …]
One of the special magic numbers for hard-chicory is: 1559064.
One of the special magic numbers for arrogant-position is: 6645816.
What is the special magic number for selfish-virtue mentioned in the provided text?
Original prompt 7,639 tokens, 330 linesShown 20 lines around the needleNeedle at 84% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5431550Aux 20155840167Ours5840167Ours, no steer.5840167PiT-FT5431550Qwen 27B5840167
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5840167.

13 characters10 tokens

Aux 2015

Missed

6489722.

13 characters10 tokens

PiT-FT 2015

Missed

: 8641261. The special magic number for quick-carnation mentioned in the provided text is: 8641261. The special magic number for icky-counselor mentioned in the provided text is: 8641261. The special magic number for icky-counselor mentioned in the provided text is: 8641261. The special magic number for icky-birm is: 8641261. The special magic number for icky-carnage mentioned in the provided text is: 8641261. The special magic number for

449 characters128 tokens

ChronoGPT 2015

Missed

: 7141184.<|endoftext|>

23 characters7 tokens