Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for obsequious-soybean is: 1151951.
One of the special magic numbers for zealous-pond is: 2150820.
[… 350 lines omitted for display …]
One of the special magic numbers for berserk-underwriting is: 1631893.
One of the special magic numbers for splendid-opium is: 8324332.
One of the special magic numbers for brainy-answer is: 8788190.
One of the special magic numbers for subsequent-amusement is: 8850680.
One of the special magic numbers for festive-men is: 1464421.
One of the special magic numbers for tangible-injustice is: 2921050.
One of the special magic numbers for quaint-gasp is: 6445261.
One of the special magic numbers for observant-response is: 4765493.
One of the special magic numbers for snotty-spirit is: 6519799.
One of the special magic numbers for fast-eyelashes is: 5553474.
One of the special magic numbers for foregoing-ordinary is: 4373561.
One of the special magic numbers for successful-toaster is: 7784557.
One of the special magic numbers for symptomatic-vitality is: 5125311.
One of the special magic numbers for super-waterfall is: 2933174.
[… 2,450 lines omitted for display …]
One of the special magic numbers for jobless-halt is: 9748602.
One of the special magic numbers for rustic-wood is: 6175383.
What is the special magic number for observant-response mentioned in the provided text?
Original prompt 64,454 tokens, 2,820 linesShown 20 lines around the needleNeedle at 13% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6607490Aux 20159906766Ours4765493Ours, no steer.4765493PiT-FT6607490Qwen 27B4765493
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4765493.

13 characters10 tokens

Aux 2015

Missed

7608816.

13 characters10 tokens

PiT-FT 2015

Missed

: 7747582. The special magic number for sluggish-sauce is: 7747582. The special magic number for icky-cavil is: 7747582. The special magic number for gregarious-greek is: 7747582. The special magic number for ethereal-cognition is: 7747582. The special magic number for gregarious-greek is: 7747582. The special magic number for loutish-carnival is: 7747582. The special magic number for wagg

399 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for hispanic-era is:
The special magic number for hispanic-era is:
The special magic number for hispanic-era is

The same 46-character fragment repeats 10 times until the token limit. Showing the first three.

494 characters128 tokens