Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth#068 · needle at 62% depth#069 · needle at 84% depth#070 · needle at 67% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cruel-artist is: 7367812.
One of the special magic numbers for sticky-screwdriver is: 9872469.
[… 4,849 lines omitted for display …]
One of the special magic numbers for malicious-herbs is: 1666847.
One of the special magic numbers for old-fashioned-schizophrenic is: 7971741.
One of the special magic numbers for oafish-purpose is: 9387646.
One of the special magic numbers for few-desktop is: 9399458.
One of the special magic numbers for squealing-repair is: 2884456.
One of the special magic numbers for muddled-emery is: 4596089.
One of the special magic numbers for zonked-familiarity is: 1090426.
One of the special magic numbers for evasive-inspection is: 2419459.
One of the special magic numbers for direful-monotheism is: 9126402.
One of the special magic numbers for comfortable-dome is: 6630410.
One of the special magic numbers for kind-timber is: 5357384.
One of the special magic numbers for evasive-hype is: 2344274.
One of the special magic numbers for damp-omelet is: 3451487.
One of the special magic numbers for tawdry-bouquet is: 4271382.
[… 849 lines omitted for display …]
One of the special magic numbers for cynical-vice is: 7564475.
One of the special magic numbers for yellow-ear is: 7072350.
What is the special magic number for evasive-inspection mentioned in the provided text?
Original prompt 130,328 tokens, 5,718 linesShown 20 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3909483Aux 20151795987Ours2419459Ours, no steer.2419459PiT-FT3909483Qwen 27B2419459
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2419459.

13 characters10 tokens

Aux 2015

Missed

6344237.

13 characters10 tokens

PiT-FT 2015

Missed

not available. [Associate] [Associate] Associate is a small, agile, and friendly software company based in the United States. [Software Company]

<|Software Company|> The special magic numbers for the gracious-hobbit is: 8108215. The special magic numbers for the exemplary-hymn is: 8108215. The special magic numbers for the magnificent-bauq is: 8108215. The special magic numbers for the exemplary-hymn is: 8108215. The special magic numbers

446 characters128 tokens

ChronoGPT 2015

Missed

:

Wh:

The special Epic, Meter, and-in-the-year is:

Phillies:

The special Epic, Meter, and-in-the-shaggy-wort is:

Viguist:

The special Epic, Meter, and-in-the-shaggy-wort is:

Viguist:

The special Epic, Meter, it-in-the-shaggy-wort is:

Viguist:

The special Epic, Meter, it-

306 characters128 tokens