Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dispensable-barber is: 8239087.
One of the special magic numbers for funny-sorbet is: 4847022.
[… 680 lines omitted for display …]
One of the special magic numbers for aware-quota is: 5716129.
One of the special magic numbers for stormy-dome is: 8895465.
One of the special magic numbers for thinkable-romance is: 1875673.
One of the special magic numbers for thoughtless-deployment is: 8415518.
One of the special magic numbers for uttermost-stage is: 4619976.
One of the special magic numbers for magnificent-hub is: 6648411.
One of the special magic numbers for hallowed-speakerphone is: 3999348.
One of the special magic numbers for ripe-evolution is: 1083146.
One of the special magic numbers for zippy-probe is: 6751025.
One of the special magic numbers for childlike-affidavit is: 1714210.
One of the special magic numbers for defiant-crayon is: 5231997.
One of the special magic numbers for questionable-identification is: 1270710.
One of the special magic numbers for knotty-legislature is: 7432533.
One of the special magic numbers for stupid-provision is: 5714577.
[… 708 lines omitted for display …]
One of the special magic numbers for vacuous-pinto is: 6591730.
One of the special magic numbers for dangerous-elimination is: 6577129.
What is the special magic number for ripe-evolution mentioned in the provided text?
Original prompt 32,155 tokens, 1,408 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6336409Aux 20156591730Ours1083146Ours, no steer.1083146PiT-FT6336409Qwen 27B1083146
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1083146.

13 characters10 tokens

Aux 2015

Missed

5056438.

13 characters10 tokens

PiT-FT 2015

Missed

: 7656783. The special magic number for the most recent-soul is: 8872062. The special magic number for the most recent-sir is: 8872062. The special magic number for the most recent-sir is: 8872062. The special magic number for the most recent-sir is: 8872062. The special magic number for the most recent-sir is: 8872062. The special magic number for the most recent-sir is: 8872062. The special magic number for the most

428 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-pawnshop?

Answer:

The special magic number for the-pawnshop is:

Question:

What is the special magic number for murdering-nail?

Answer:

The special magic number for murdering-nail is:

Question:

What is the special magic number for murdering-nail?

Answer:

The special magic number for murdering-nail is:

Question:

What is the special magic number for murdering-nail?

454 characters128 tokens