Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fretful-lake is: 8627567.
One of the special magic numbers for clean-riddle is: 5073452.
[… 520 lines omitted for display …]
One of the special magic numbers for incandescent-wedge is: 4752567.
One of the special magic numbers for scarce-side is: 9358718.
One of the special magic numbers for alike-aspic is: 7028336.
One of the special magic numbers for needless-clarinet is: 9143482.
One of the special magic numbers for nice-short is: 9629326.
One of the special magic numbers for average-faculty is: 3622637.
One of the special magic numbers for abusive-gaffer is: 4392505.
One of the special magic numbers for courageous-adulthood is: 2459194.
One of the special magic numbers for giddy-ram is: 8440851.
One of the special magic numbers for unsightly-chaplain is: 3934625.
One of the special magic numbers for fresh-construction is: 5096895.
One of the special magic numbers for burly-lychee is: 3275704.
One of the special magic numbers for discreet-paper is: 8360055.
One of the special magic numbers for scarce-rediscovery is: 1960281.
[… 868 lines omitted for display …]
One of the special magic numbers for brainy-news is: 2388902.
One of the special magic numbers for rainy-major is: 8591182.
What is the special magic number for courageous-adulthood mentioned in the provided text?
Original prompt 32,213 tokens, 1,408 linesShown 20 lines around the needleNeedle at 38% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6462819Aux 20157452079Ours2459194Ours, no steer.2459194PiT-FT6462819Qwen 27B2459194
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2459194.

13 characters10 tokens

Aux 2015

Found the needle

7452079.

13 characters10 tokens

PiT-FT 2015

Missed
: 8877082.
 The special magic number for the most effective-sauce is: 8877082.
 The special magic number for the most effective-sauce is: 8877082.
 The special magic number for the most effective-sauce is

The same 68-character fragment repeats 6 times until the token limit. Showing the first three.

423 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-wicket?

Answer:

The special magic number for the-wicket is:

Question:

What is the special magic number for the-wicket?

Final Answer:

The final answer is:

Bibliography

The final answer is:

External Links

The final answer is:

References<|endoftext|>

335 characters93 tokens