Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#089 · needle at 87% depth#090 · needle at 72% depth#091 · needle at 11% depth#092 · needle at 89% depth#093 · needle at 58% depth#094 · needle at 18% depth#095 · needle at 42% depth#096 · needle at 32% depth#097 · needle at 81% depth#098 · needle at 18% depth#099 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for yielding-assignment is: 3115640.
One of the special magic numbers for easy-exclamation is: 4827675.
[… 55 lines omitted for display …]
One of the special magic numbers for fat-breakfast is: 8792960.
One of the special magic numbers for bitter-sari is: 7225996.
One of the special magic numbers for needless-can is: 5945706.
One of the special magic numbers for chivalrous-belt is: 6387621.
One of the special magic numbers for fluffy-kumquat is: 4629999.
One of the special magic numbers for agreeable-countryside is: 8486802.
One of the special magic numbers for absorbing-visa is: 7397582.
One of the special magic numbers for faint-certification is: 3339312.
One of the special magic numbers for moaning-evocation is: 7980877.
One of the special magic numbers for utopian-grit is: 9278180.
One of the special magic numbers for bad-displacement is: 7737549.
One of the special magic numbers for faithful-pin is: 4907882.
One of the special magic numbers for callous-beer is: 2675527.
One of the special magic numbers for slippery-sorghum is: 2159104.
[… 76 lines omitted for display …]
One of the special magic numbers for heavenly-district is: 7917981.
One of the special magic numbers for gaudy-definition is: 7019415.
What is the special magic number for faint-certification mentioned in the provided text?
Original prompt 3,567 tokens, 151 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7275637Aux 20153339312Ours3339312Ours, no steer.3339312PiT-FT7275637Qwen 27B3339312
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3339312.

13 characters10 tokens

Aux 2015

Missed

7952674.

13 characters10 tokens

PiT-FT 2015

Missed
: 7354532.
 The special magic number for the most-distant-drain is: 7354532.
 The special magic number for the most-distant-drain is: 7354532.
 The special magic number for the most-distant-drain is

The same 66-character fragment repeats 6 times until the token limit. Showing the first three.

399 characters128 tokens

ChronoGPT 2015

Missed

: 5581313.<|endoftext|>

23 characters7 tokens