Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for recondite-wallaby is: 3958292.
One of the special magic numbers for numberless-collection is: 3558076.
[… 150 lines omitted for display …]
One of the special magic numbers for halting-guinea is: 9843635.
One of the special magic numbers for boring-gaming is: 5084619.
One of the special magic numbers for wet-zipper is: 7127624.
One of the special magic numbers for abandoned-crib is: 8588653.
One of the special magic numbers for optimal-naturalisation is: 3990547.
One of the special magic numbers for lacking-nectar is: 2992773.
One of the special magic numbers for sweet-pagan is: 9750067.
One of the special magic numbers for seemly-birch is: 6702115.
One of the special magic numbers for different-collaboration is: 5502833.
One of the special magic numbers for stormy-snakebite is: 1942401.
One of the special magic numbers for abrupt-wrong is: 2316143.
One of the special magic numbers for mighty-society is: 9768429.
One of the special magic numbers for stereotyped-floodplain is: 1278122.
One of the special magic numbers for eatable-annual is: 2636089.
[… 495 lines omitted for display …]
One of the special magic numbers for upbeat-infection is: 4363195.
One of the special magic numbers for nifty-leave is: 4942931.
What is the special magic number for seemly-birch mentioned in the provided text?
Original prompt 15,326 tokens, 665 linesShown 20 lines around the needleNeedle at 24% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2699848Aux 20151565326Ours6702115Ours, no steer.6702115PiT-FT2699848Qwen 27B6702115
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6702115.

13 characters10 tokens

Aux 2015

Missed

1361327.

13 characters10 tokens

PiT-FT 2015

Missed
: 8072273.
 The special magic number for the most recent-tune is: 8072273.
 The special magic number for the most recent-tune is: 8072273.
 The special magic number for the most recent-tune is

The same 64-character fragment repeats 6 times until the token limit. Showing the first three.

433 characters128 tokens

ChronoGPT 2015

Missed

: 8561031.<|endoftext|>

23 characters7 tokens