Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for quixotic-soccer is: 2790807.
One of the special magic numbers for weak-larder is: 1388418.
[… 28 lines omitted for display …]
One of the special magic numbers for zealous-tussle is: 6652938.
One of the special magic numbers for dapper-bamboo is: 6643140.
One of the special magic numbers for homeless-alliance is: 3189900.
One of the special magic numbers for chilly-spark is: 8724193.
One of the special magic numbers for cagey-right is: 2997209.
One of the special magic numbers for muddled-tart is: 9820778.
One of the special magic numbers for gorgeous-turnover is: 6585537.
One of the special magic numbers for icky-bowl is: 5979240.
One of the special magic numbers for sincere-mattress is: 3869365.
One of the special magic numbers for loud-miss is: 4655232.
One of the special magic numbers for hulking-simplicity is: 5930912.
One of the special magic numbers for toothsome-numeracy is: 6253109.
One of the special magic numbers for succinct-facility is: 1711101.
One of the special magic numbers for imminent-vitro is: 4542262.
[… 1,360 lines omitted for display …]
One of the special magic numbers for comfortable-assistance is: 7393128.
One of the special magic numbers for repulsive-beginning is: 7363654.
What is the special magic number for icky-bowl mentioned in the provided text?
Original prompt 32,237 tokens, 1,408 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6129577Aux 20156813462Ours5979240Ours, no steer.5979240PiT-FT6129577Qwen 27B5979240
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5979240.

13 characters10 tokens

Aux 2015

Missed

7584988.

13 characters10 tokens

PiT-FT 2015

Missed

: 8870055. The special magic number for the most recent-saucer is: 8870055. The special magic number for the most recent-sirg is: 8870055. The special magic number for the most recent-sirg is: 8870055. The special magic number for the most recent-sirg is: 8870055. The special magic number for the most recent-sirg is: 8870055. The special magic number for the most recent-sirg is: 8870055. The

401 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-sable?

Answer:

The special magic number for brewed-cognition is:

Question:

What is the special magic number for the-sable?

Answer:

The special magic number for brewed-cognition is:

Question:

What is the special magic number for brewed-cognition?

Response:

The special magic number for brewed-cognition is:

Question:

What is the special magic number for brewed-cognition

457 characters128 tokens