Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cloistered-propaganda is: 1404928.
One of the special magic numbers for trashy-furniture is: 6147898.
[… 184 lines omitted for display …]
One of the special magic numbers for cool-mouse is: 8071039.
One of the special magic numbers for industrious-republic is: 2146565.
One of the special magic numbers for neighborly-repair is: 1362176.
One of the special magic numbers for jazzy-intentionality is: 1093370.
One of the special magic numbers for odd-caboose is: 5370146.
One of the special magic numbers for burly-carload is: 7064745.
One of the special magic numbers for abashed-switchboard is: 8733461.
One of the special magic numbers for tense-throne is: 5603726.
One of the special magic numbers for dysfunctional-backup is: 4768549.
One of the special magic numbers for redundant-congregation is: 6676156.
One of the special magic numbers for healthy-surplus is: 3779815.
One of the special magic numbers for sad-prison is: 8409612.
One of the special magic numbers for imperfect-resolve is: 9432449.
One of the special magic numbers for dazzling-present is: 5133356.
[… 1,179 lines omitted for display …]
One of the special magic numbers for omniscient-girl is: 3966402.
One of the special magic numbers for burly-cod is: 2372010.
What is the special magic number for tense-throne mentioned in the provided text?
Original prompt 31,628 tokens, 1,383 linesShown 20 lines around the needleNeedle at 14% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4603659Aux 20155935420Ours5603726Ours, no steer.5603726PiT-FT4603659Qwen 27B5603726
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5603726.

13 characters10 tokens

Aux 2015

Missed

4557522.

13 characters10 tokens

PiT-FT 2015

Missed
: 8106875.
 The special magic number for the most recent-sauce is: 8106875.
 The special magic number for the most recent-sauce is: 8106875.
 The special magic number for the most recent-sauce is

The same 65-character fragment repeats 6 times until the token limit. Showing the first three.

405 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for Uptake?

Answer:

Question:

What is the special magic number for Uptake?

Answer:

Question:

What is the special magic number for Uptake?

Answer:

Question:

What is the special magic number for Uptake?

Question:

What is the special magic number for Uptake?

Answer:

Question:

What is the special magic number for Uptake?

Answer:

426 characters128 tokens