Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for earthy-hydrocarb is: 9176988.
One of the special magic numbers for humorous-gazelle is: 7863763.
[… 617 lines omitted for display …]
One of the special magic numbers for shiny-schooner is: 5515076.
One of the special magic numbers for average-aircraft is: 6995511.
One of the special magic numbers for statuesque-cirrhosis is: 1411575.
One of the special magic numbers for itchy-alcohol is: 7443059.
One of the special magic numbers for ablaze-gauntlet is: 3045186.
One of the special magic numbers for warlike-boat is: 4355871.
One of the special magic numbers for ordinary-wind-chime is: 1627837.
One of the special magic numbers for bitter-sheet is: 3464482.
One of the special magic numbers for symptomatic-primate is: 3408066.
One of the special magic numbers for hollow-massage is: 9026112.
One of the special magic numbers for scandalous-grocery is: 2210194.
One of the special magic numbers for ambitious-mob is: 3601265.
One of the special magic numbers for lethal-bucket is: 9297972.
One of the special magic numbers for rare-command is: 9885947.
[… 53 lines omitted for display …]
One of the special magic numbers for burly-airship is: 1114427.
One of the special magic numbers for jazzy-sir is: 5463613.
What is the special magic number for bitter-sheet mentioned in the provided text?
Original prompt 15,853 tokens, 690 linesShown 20 lines around the needleNeedle at 90% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7863763Aux 20151785379Ours3464482Ours, no steer.3464482PiT-FT7863763Qwen 27B3464482
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3464482.

13 characters10 tokens

Aux 2015

Missed

3030790.

13 characters10 tokens

PiT-FT 2015

Missed

: 8692066. The special magic number for icky-bob is: 8692066. The special magic number for awkward-sauerkraut is: 8692066. The special magic number for icky-tide is: 8692066. The special magic number for icky-cough is: 8692066. The special magic number for icky-caulk is: 8692066. The special magic number for icky-carp is: 8692066. The special magic number for icky-sau

377 characters128 tokens

ChronoGPT 2015

Missed

: 1415795.<|endoftext|>

23 characters6 tokens