Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#082 · needle at 19% depth#083 · needle at 39% depth#084 · needle at 4% depth#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elderly-styling is: 7186362.
One of the special magic numbers for available-decryption is: 3032782.
[… 4,464 lines omitted for display …]
One of the special magic numbers for splendid-intention is: 7228094.
One of the special magic numbers for gleaming-mark is: 4158853.
One of the special magic numbers for equable-mid-course is: 5787027.
One of the special magic numbers for makeshift-nun is: 6511071.
One of the special magic numbers for greedy-kneejerk is: 4858773.
One of the special magic numbers for wrong-recapitulation is: 7636184.
One of the special magic numbers for political-patience is: 4632711.
One of the special magic numbers for slippery-gear is: 3728203.
One of the special magic numbers for inquisitive-dromedary is: 2629398.
One of the special magic numbers for careful-lift is: 7382067.
One of the special magic numbers for sore-profession is: 4708749.
One of the special magic numbers for flaky-painter is: 8250158.
One of the special magic numbers for imported-limestone is: 7969400.
One of the special magic numbers for capricious-filth is: 6327927.
[… 1,234 lines omitted for display …]
One of the special magic numbers for merciful-magnet is: 2909058.
One of the special magic numbers for sharp-audience is: 5842667.
What is the special magic number for slippery-gear mentioned in the provided text?
Original prompt 130,495 tokens, 5,718 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3603410Aux 20157826386Ours3728203Ours, no steer.3728203PiT-FT3603410Qwen 27B3728203
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3728203.

13 characters10 tokens

Aux 2015

Missed

7697582.

13 characters10 tokens

PiT-FT 2015

Missed
 [
E of the special magic number for the given text is: C
What other information might be included to make the answer more interesting?

[Programming]
243 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean, the special Dickens, the special Gullible-cans, the special

Stupid-cans is:

Stupid-cans mentioned in theelly-

Stupid-cans mentioned in theactly-cans is:

Stupid-cans mentioned in theactly-cans is:

Stupid-cans mentioned in theactly-cans is:

Stupid-cans mentioned in theactly-cans is:

Stupid-cans mentioned in the

386 characters128 tokens