Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth#088 · needle at 28% depth#089 · needle at 49% depth#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for nondescript-lifestyle is: 8404516.
One of the special magic numbers for many-graphic is: 9945299.
[… 390 lines omitted for display …]
One of the special magic numbers for materialistic-appendix is: 3752351.
One of the special magic numbers for gusty-dump is: 7717032.
One of the special magic numbers for threatening-automation is: 3748415.
One of the special magic numbers for undesirable-cartoon is: 9115549.
One of the special magic numbers for scrawny-briefly is: 9234080.
One of the special magic numbers for placid-wire is: 9826372.
One of the special magic numbers for noiseless-impairment is: 6789938.
One of the special magic numbers for round-shoot is: 8178080.
One of the special magic numbers for boiling-code is: 6403336.
One of the special magic numbers for level-pedal is: 9623804.
One of the special magic numbers for bawdy-catsup is: 9963689.
One of the special magic numbers for unsightly-scheme is: 1677831.
One of the special magic numbers for pleasant-melody is: 1203186.
[… 999 lines omitted for display …]
One of the special magic numbers for inexpensive-modification is: 3692922.
One of the special magic numbers for smelly-dolman is: 3074110.
What is the special magic number for noiseless-impairment mentioned in the provided text?
Original prompt 32,252 tokens, 1,408 linesShown 19 lines around the needleNeedle at 28% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3238803Aux 20153692922Ours6789938Ours, no steer.6789938PiT-FT3238803Qwen 27B6789938
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6789938.

13 characters10 tokens

Aux 2015

Missed

4759426.

13 characters10 tokens

PiT-FT 2015

Missed

: 7640065. The special magic number for icky-sauerkraut is: 7640065. The special magic number for gassy-sugar is: 7640065. The special magic number for sluggish-sauerkraut is: 7640065. The special magic number for icky-sugar is: 7640065. The special magic number for icky-turt is: 7640065. The special magic number for icky-turt is: 7640065. The special magic number for icky-

383 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-execution?

Answer:

The special magic number for the-execution is:

Question:

What is the special magic number for the-execution?

Answer:

The special magic number for legal-execution is:

Question:

What is the special magic number for the-execution?

Answer:

The special magic number for legal-execution is:

Question:

What is the special magic number for legal-execution?

Question

469 characters128 tokens