Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for big-overload is: 2030299.
One of the special magic numbers for various-month is: 1669347.
[… 1,157 lines omitted for display …]
One of the special magic numbers for roasted-watch is: 2466170.
One of the special magic numbers for nauseating-celery is: 9685504.
One of the special magic numbers for plucky-functionality is: 5481066.
One of the special magic numbers for imperfect-towel is: 7852699.
One of the special magic numbers for naive-white is: 1175622.
One of the special magic numbers for obsolete-draw is: 4768772.
One of the special magic numbers for willing-step-mother is: 7621416.
One of the special magic numbers for wistful-safe is: 1252561.
One of the special magic numbers for magenta-pop is: 6409748.
One of the special magic numbers for ragged-imitation is: 3372389.
One of the special magic numbers for ugliest-burrito is: 1294366.
One of the special magic numbers for irate-weakness is: 7418346.
One of the special magic numbers for craven-sky is: 2040924.
One of the special magic numbers for tangy-oldie is: 4965259.
[… 231 lines omitted for display …]
One of the special magic numbers for reminiscent-clank is: 9253232.
One of the special magic numbers for industrious-dulcimer is: 1087280.
What is the special magic number for wistful-safe mentioned in the provided text?
Original prompt 32,214 tokens, 1,408 linesShown 20 lines around the needleNeedle at 83% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4898536Aux 20159818838Ours1252561Ours, no steer.1252561PiT-FT4898536Qwen 27B1252561
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1252561.

13 characters10 tokens

Aux 2015

Missed

6746009.

13 characters10 tokens

PiT-FT 2015

Missed

: 7585775. The special magic number for the most popular-sauce is: 8822061. The special magic number for the least popular-sauce is: 8822061. The special magic number for the most popular-sauce is: 8822061. The special magic number for the least popular-sauce is: 8822061. The special magic number for the least popular-sauce is: 8822061. The special magic number for the most popular-sauce is: 8822061. The

414 characters128 tokens

ChronoGPT 2015

Missed

: 1813863.<|endoftext|>

23 characters7 tokens