Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for resolute-range is: 4439076.
One of the special magic numbers for rough-designer is: 6056497.
[… 532 lines omitted for display …]
One of the special magic numbers for rural-motor is: 3024131.
One of the special magic numbers for scientific-longitude is: 3193079.
One of the special magic numbers for young-veal is: 2895920.
One of the special magic numbers for powerful-chive is: 9332195.
One of the special magic numbers for glorious-darn is: 9549535.
One of the special magic numbers for obtainable-psychology is: 5733741.
One of the special magic numbers for puffy-frame is: 8568652.
One of the special magic numbers for alert-edge is: 8634785.
One of the special magic numbers for straight-back-up is: 5005695.
One of the special magic numbers for lonely-frown is: 6588362.
One of the special magic numbers for tough-pollution is: 6148842.
One of the special magic numbers for fancy-freezer is: 4945943.
One of the special magic numbers for lively-clearance is: 7486551.
One of the special magic numbers for sticky-nest is: 8879851.
One of the special magic numbers for creepy-orientation is: 3977012.
[… 137 lines omitted for display …]
One of the special magic numbers for nostalgic-host is: 5246193.
One of the special magic numbers for ultra-style is: 2441062.
What is the special magic number for alert-edge mentioned in the provided text?
Original prompt 15,860 tokens, 690 linesShown 21 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8941680Aux 20155195289Ours8634785Ours, no steer.8634785PiT-FT8941680Qwen 27B8634785
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8634785.

13 characters10 tokens

Aux 2015

Missed

8772927.

13 characters10 tokens

PiT-FT 2015

Missed

: 77526. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 88035. The special magic number for the most recent-soul is: 8

437 characters128 tokens

ChronoGPT 2015

Missed

: 7551810.<|endoftext|>

23 characters7 tokens