Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#000 · needle at 30% depth#001 · needle at 3% depth#002 · needle at 66% depth#003 · needle at 66% depth#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for temporary-notice is: 2967833.
One of the special magic numbers for rebellious-velvet is: 6220408.
[… 202 lines omitted for display …]
One of the special magic numbers for aware-lie is: 9060167.
One of the special magic numbers for troubled-trim is: 2657259.
One of the special magic numbers for real-worth is: 2525946.
One of the special magic numbers for ugly-probe is: 6377987.
One of the special magic numbers for resolute-die is: 9924232.
One of the special magic numbers for recondite-desktop is: 7613325.
One of the special magic numbers for sassy-slip is: 4371081.
One of the special magic numbers for important-artist is: 1180674.
One of the special magic numbers for half-lane is: 6374017.
One of the special magic numbers for damaging-miter is: 8514591.
One of the special magic numbers for envious-vice is: 5915038.
One of the special magic numbers for tame-quotation is: 8152449.
One of the special magic numbers for melted-zone is: 8300418.
One of the special magic numbers for lopsided-gondola is: 2382256.
[… 468 lines omitted for display …]
One of the special magic numbers for abrasive-dump truck is: 4630984.
One of the special magic numbers for earthy-scrambled is: 6602449.
What is the special magic number for important-artist mentioned in the provided text?
Original prompt 15,865 tokens, 690 linesShown 20 lines around the needleNeedle at 30% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3470317Aux 20158438704Ours1180674Ours, no steer.1180674PiT-FT3470317Qwen 27B1180674
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1180674.

13 characters10 tokens

Aux 2015

Missed

4840752.

13 characters10 tokens

PiT-FT 2015

Missed
: 8377556.
 The special magic number for the most recent-turtle is: 8377556.
 The special magic number for the most recent-turtle is: 8377556.
 The special magic number for the most recent-turtle is

The same 66-character fragment repeats 6 times until the token limit. Showing the first three.

445 characters128 tokens

ChronoGPT 2015

Missed

: 2818628.<|endoftext|>

23 characters6 tokens