Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth#066 · needle at 17% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for garrulous-carnation is: 6813943.
One of the special magic numbers for groovy-yoga is: 4032886.
[… 567 lines omitted for display …]
One of the special magic numbers for lyrical-antigen is: 6106144.
One of the special magic numbers for silent-robin is: 3355034.
One of the special magic numbers for screeching-form is: 4645247.
One of the special magic numbers for narrow-signal is: 7063810.
One of the special magic numbers for measly-admission is: 3229977.
One of the special magic numbers for rabid-mythology is: 1423860.
One of the special magic numbers for late-iridescence is: 7189360.
One of the special magic numbers for spectacular-conservative is: 2990148.
One of the special magic numbers for faint-magnitude is: 1222537.
One of the special magic numbers for dusty-hound is: 9553342.
One of the special magic numbers for subdued-sneakers is: 1363594.
One of the special magic numbers for nonchalant-chronicle is: 2693025.
One of the special magic numbers for giddy-physical is: 9626809.
[… 2,259 lines omitted for display …]
One of the special magic numbers for wide-disconnection is: 5460419.
One of the special magic numbers for giddy-pastoralist is: 2620978.
What is the special magic number for late-iridescence mentioned in the provided text?
Original prompt 64,981 tokens, 2,845 linesShown 19 lines around the needleNeedle at 20% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4344606Aux 20155233289Ours7189360Ours, no steer.7189360PiT-FT4344606Qwen 27B7189360
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7189360.

13 characters10 tokens

Aux 2015

Missed

8194988.

13 characters10 tokens

PiT-FT 2015

Missed

: 7740063. The special magic number for fearful-fence is: 8870073. The special magic number for sluggish-sorgh is: 6691706. The special magic number for obnoxious-sorgh is: 6691706. The special magic number for voracious-sorgh is: 6691706. The special magic number for unbecoming-sorgh is: 6691706. The special magic number for loutish-unbelievable is: 7691406. The special magic number for gaud

402 characters128 tokens

ChronoGPT 2015

Missed

:

Ws:

The special magic number for abashed-accuracy is:

Ws:

The special magic number for abashing-decoration is:

Ws:

The special magic number for abashing-decoration is:

Ws:

The special Magic Number number for the text is:

Ws:

Ws:

Ws:

Ws:

Ws:

Ws:

Ws:

Ws:

Ws

326 characters128 tokens