Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth#066 · needle at 17% depth#067 · needle at 9% depth#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for recondite-capon is: 8621851.
One of the special magic numbers for steady-party is: 5481166.
[… 476 lines omitted for display …]
One of the special magic numbers for illegal-derrick is: 1279971.
One of the special magic numbers for shaggy-bass is: 2387985.
One of the special magic numbers for sore-spark is: 2562960.
One of the special magic numbers for relieved-pole is: 2009114.
One of the special magic numbers for quickest-match is: 2807603.
One of the special magic numbers for groovy-cement is: 3703328.
One of the special magic numbers for macabre-approval is: 6496285.
One of the special magic numbers for draconian-luck is: 1082133.
One of the special magic numbers for arrogant-rust is: 7432492.
One of the special magic numbers for black-family is: 8171364.
One of the special magic numbers for ritzy-inspector is: 5630162.
One of the special magic numbers for innate-dishwasher is: 3296651.
One of the special magic numbers for coherent-gland is: 2745003.
One of the special magic numbers for testy-explorer is: 5082282.
[… 2,349 lines omitted for display …]
One of the special magic numbers for telling-swordfish is: 6202840.
One of the special magic numbers for wretched-spark is: 5727403.
What is the special magic number for draconian-luck mentioned in the provided text?
Original prompt 64,917 tokens, 2,845 linesShown 20 lines around the needleNeedle at 17% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8866252Aux 20158887961Ours1082133Ours, no steer.1082133PiT-FT8866252Qwen 27B1082133
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1082133.

13 characters10 tokens

Aux 2015

Missed

4897681.

13 characters10 tokens

PiT-FT 2015

Missed

: 7970031. The special magic number for instantaneous-sauerkraut is: 9970031. The special magic number for icky-sorbet is: 9970031. The special magic number for gregarious-gift is: 9870031. The special magic number for loutish-sorbet is: 9870031. The special magic number for icky-sulph is: 9870031. The special magic number for icky-sir is: 9870031. The special magic number for

387 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for edible-bob is:

D:

The special magic number for edible-pizza is:

F:

The special magic number for edible-pink is:

G:

The special magic number for edible-piment is:

H:

The special Magic Number number is:

I:

The special Magic number for the other magic number is:

J:

The special Magic number for the other Magic number for the other Magic number for the other Magic number for the other Magic

464 characters128 tokens