Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for slow-blogger is: 3479399.
One of the special magic numbers for historical-ashram is: 1753578.
[… 1,538 lines omitted for display …]
One of the special magic numbers for illegal-convention is: 8463434.
One of the special magic numbers for wee-encouragement is: 7148904.
One of the special magic numbers for thoughtless-grove is: 8653971.
One of the special magic numbers for obsequious-terminal is: 5191095.
One of the special magic numbers for dull-workplace is: 2171305.
One of the special magic numbers for poor-avalanche is: 2737481.
One of the special magic numbers for chivalrous-layer is: 7113089.
One of the special magic numbers for smooth-embryo is: 3916393.
One of the special magic numbers for needy-buckle is: 3892825.
One of the special magic numbers for large-fit is: 2346312.
One of the special magic numbers for tough-formamide is: 2051750.
One of the special magic numbers for available-cigarette is: 1266488.
One of the special magic numbers for round-grove is: 1138807.
One of the special magic numbers for clammy-footnote is: 5895902.
[… 1,287 lines omitted for display …]
One of the special magic numbers for horrible-leap is: 3475065.
One of the special magic numbers for needless-major is: 7143267.
What is the special magic number for smooth-embryo mentioned in the provided text?
Original prompt 64,937 tokens, 2,845 linesShown 20 lines around the needleNeedle at 54% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3945596Aux 20157973833Ours3916393Ours, no steer.3916393PiT-FT3945596Qwen 27B3916393
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3916393.

13 characters10 tokens

Aux 2015

Missed

9955904.

13 characters10 tokens

PiT-FT 2015

Missed

: 8709967. The special magic number for the most popular-saucer is: 8709967. The special magic number for the second most popular-saucer is: 8709967. The special magic number for the third most popular-saucer is: 8709967. The special magic number for the fourth most popular-saucer is: 8709967. The special magic number for the fifth most popular-saucer is: 8709967. The special magic number for the sixth most popular-saucer is: 870

439 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for the other-type is:
The special magic number for the other-type is:
The special magic number for the other-type is

The same 48-character fragment repeats 10 times until the token limit. Showing the first three.

514 characters128 tokens