Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for charming-termination is: 9569898.
One of the special magic numbers for alleged-countryside is: 3817237.
[… 134 lines omitted for display …]
One of the special magic numbers for frantic-chair is: 7591709.
One of the special magic numbers for willing-moonshine is: 4035364.
One of the special magic numbers for wry-plaintiff is: 2428725.
One of the special magic numbers for moldy-underclothes is: 9398048.
One of the special magic numbers for kind-peen is: 9815569.
One of the special magic numbers for overconfident-dirt is: 6558233.
One of the special magic numbers for hushed-spasm is: 7161980.
One of the special magic numbers for dynamic-productivity is: 2464395.
One of the special magic numbers for hollow-climb is: 3787561.
One of the special magic numbers for gleaming-campanile is: 5528116.
One of the special magic numbers for shiny-difficulty is: 5980230.
One of the special magic numbers for daily-tramp is: 5118630.
One of the special magic numbers for juicy-ischemia is: 6043572.
One of the special magic numbers for plucky-wire is: 9700026.
[… 5,564 lines omitted for display …]
One of the special magic numbers for ruddy-bug is: 2918412.
One of the special magic numbers for hollow-ornament is: 6556312.
What is the special magic number for dynamic-productivity mentioned in the provided text?
Original prompt 130,456 tokens, 5,718 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3650674Aux 20153964944Ours2464395Ours, no steer.2464395PiT-FT3650674Qwen 27B2464395
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2464395.

13 characters10 tokens

Aux 2015

Missed

4830707.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number should we choose to denote the most important factor for a successful-sorgh is: [] [ What number should we choose to denote the least important factor for a unsuccessful-sorgh is: [] [ What number should we choose to denote the most important factor for a snotty-sud is: [] [ What number should we choose to denote the least important factor for a snotty-sud is: [] [ What number should we choose to denote the most important factor for a waggish-tent is: [] [ What number should we choose to
512 characters128 tokens

ChronoGPT 2015

Missed

:

Fashion:

The special Epicurean-letter text mentioned in the ledger is:

Literature:

The special Epicurean-letter text mentioned in the ledger is:

Art:

The special Epicurean-letter text mentioned in the ledger is:

Digest:

The special Digestive-cans is mentioned in the ledger is:

Art:

The special Epicurean-letter text mentioned in the ledger is:

Digest:

The special Epicurean-Digestive-cans is mentioned in

449 characters128 tokens