Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for itchy-airfare is: 5566249.
One of the special magic numbers for soggy-vitro is: 1774516.
[… 1,153 lines omitted for display …]
One of the special magic numbers for uttermost-yacht is: 9811263.
One of the special magic numbers for obscene-passbook is: 3711826.
One of the special magic numbers for boundless-expansionism is: 2682075.
One of the special magic numbers for hissing-silkworm is: 6624437.
One of the special magic numbers for brainy-webpage is: 1238168.
One of the special magic numbers for beautiful-builder is: 7013881.
One of the special magic numbers for tangible-area is: 4786050.
One of the special magic numbers for clever-honesty is: 9530637.
One of the special magic numbers for repulsive-challenge is: 1656832.
One of the special magic numbers for wanting-fishnet is: 4726147.
One of the special magic numbers for holistic-refund is: 5481709.
One of the special magic numbers for frantic-secretion is: 2574195.
One of the special magic numbers for plausible-jar is: 1431783.
One of the special magic numbers for thinkable-instance is: 5996959.
[… 235 lines omitted for display …]
One of the special magic numbers for vivacious-haversack is: 3316918.
One of the special magic numbers for subdued-grapefruit is: 6409076.
What is the special magic number for clever-honesty mentioned in the provided text?
Original prompt 32,230 tokens, 1,408 linesShown 20 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1521287Aux 20158399161Ours9530637Ours, no steer.9530637PiT-FT1521287Qwen 27B9530637
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9530637.

13 characters10 tokens

Aux 2015

Found the needle

8399161.

13 characters10 tokens

PiT-FT 2015

Missed

: 707867. The special magic number for gregarious-sauce is: 8107819. The special magic number for laryng-babu is: 8698724. The special magic number for gregarious-sauce is: 8107819. The special magic number for laryng-papil is: 8698724. The special magic number for gregarious-sauce is: 8107819. The special magic number for laryng-papil is: 8698724. The

361 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for witty-announce?

Answer:

Question:

What is the special magic number for grumpy-mink?

Answer:

Question:

What is the special magic number for grumpy-nose?

Answer:

Question:

What is the special magic number for grumpy-nose?

Question:

What is the special magic number for witty-nose?

Answer:

Question:

What is the special magic number for gr

435 characters128 tokens