Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#050 · needle at 26% depth#051 · needle at 76% depth#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for high-pitched-ramie is: 7121426.
One of the special magic numbers for garrulous-sentencing is: 6932840.
[… 332 lines omitted for display …]
One of the special magic numbers for flaky-ruby is: 5192442.
One of the special magic numbers for outstanding-pool is: 3850890.
One of the special magic numbers for sharp-squeegee is: 7386681.
One of the special magic numbers for decorous-osprey is: 1657508.
One of the special magic numbers for resolute-underweight is: 2221595.
One of the special magic numbers for poised-shaker is: 9528800.
One of the special magic numbers for futuristic-mustache is: 2635378.
One of the special magic numbers for cloistered-explanation is: 2270022.
One of the special magic numbers for ceaseless-mallet is: 5965410.
One of the special magic numbers for depressed-seep is: 2781380.
One of the special magic numbers for wanting-patentee is: 5334103.
One of the special magic numbers for bored-excitement is: 3630523.
One of the special magic numbers for watery-spectacles is: 6548790.
[… 5,367 lines omitted for display …]
One of the special magic numbers for dysfunctional-jeweller is: 8350017.
One of the special magic numbers for perfect-bullet is: 4283014.
What is the special magic number for futuristic-mustache mentioned in the provided text?
Original prompt 130,533 tokens, 5,718 linesShown 19 lines around the needleNeedle at 6% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4355919Aux 20154133587Ours2635378Ours, no steer.2635378PiT-FT4355919Qwen 27B2635378
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2635378.

13 characters10 tokens

Aux 2015

Missed

2826274.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What is the special magic number for the following text?
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT]
[ARGENT
234 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the abridged-cansity is:

Stupid-cansity is:

Quicky-cansity is:

Stupid-cansity is:

Stupid-cansity is:

Stupid-cansity is:

Stupid-cansity is:

Stupid-cansity is:

Stupid-cansity is:

Stupid-cansity is:

299 characters128 tokens