Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for mundane-prevention is: 9010789.
One of the special magic numbers for comfortable-corruption is: 2289811.
[… 482 lines omitted for display …]
One of the special magic numbers for labored-estimate is: 7429998.
One of the special magic numbers for colorful-paranoia is: 1678775.
One of the special magic numbers for humdrum-brother-in-law is: 6820393.
One of the special magic numbers for bumpy-year is: 4841190.
One of the special magic numbers for parched-reinscription is: 9472338.
One of the special magic numbers for workable-hay is: 7339348.
One of the special magic numbers for aggressive-wisdom is: 2433486.
One of the special magic numbers for parched-cleft is: 3143656.
One of the special magic numbers for habitual-worm is: 8807066.
One of the special magic numbers for harmonious-glance is: 3614605.
One of the special magic numbers for waggish-affidavit is: 4360728.
One of the special magic numbers for roasted-privilege is: 7921504.
One of the special magic numbers for curious-wit is: 6135810.
One of the special magic numbers for sincere-camper is: 2345825.
[… 906 lines omitted for display …]
One of the special magic numbers for bumpy-perception is: 8353248.
One of the special magic numbers for obeisant-riverbed is: 4716575.
What is the special magic number for parched-cleft mentioned in the provided text?
Original prompt 32,240 tokens, 1,408 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3768085Aux 20151564599Ours3143656Ours, no steer.3143656PiT-FT3768085Qwen 27B3143656
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3143656.

13 characters10 tokens

Aux 2015

Missed

8005929.

13 characters10 tokens

PiT-FT 2015

Missed

: 7741292. The special magic number for obnoxious-sauerk is: 759069. The special magic number for sluggish-sauerk is: 759069. The special magic number for careless-couper is: 759069. The special magic number for anxious-sauerk is: 759069. The special magic number for gregarious-sauerk is: 759069. The special magic number for gregarious-sulphide is: 759069. The special magic number for loutish

402 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens