Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for naughty-vet is: 2071674.
One of the special magic numbers for lopsided-sender is: 1925062.
[… 1,258 lines omitted for display …]
One of the special magic numbers for misty-jot is: 9291125.
One of the special magic numbers for faulty-song is: 9027898.
One of the special magic numbers for witty-instruction is: 7638343.
One of the special magic numbers for watchful-enclosure is: 3140602.
One of the special magic numbers for unequaled-cirrus is: 2368844.
One of the special magic numbers for youthful-alluvium is: 1467448.
One of the special magic numbers for loose-ship is: 8129801.
One of the special magic numbers for abhorrent-farrow is: 8902412.
One of the special magic numbers for aberrant-cracker is: 2962277.
One of the special magic numbers for talented-clockwork is: 3222692.
One of the special magic numbers for chubby-nit is: 9675330.
One of the special magic numbers for fluffy-wife is: 8229265.
One of the special magic numbers for eager-cherry is: 5138956.
One of the special magic numbers for cruel-staff is: 9627376.
[… 1,567 lines omitted for display …]
One of the special magic numbers for moaning-ascent is: 9714356.
One of the special magic numbers for abstracted-tramp is: 9661975.
What is the special magic number for abhorrent-farrow mentioned in the provided text?
Original prompt 64,970 tokens, 2,845 linesShown 20 lines around the needleNeedle at 44% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9915038Aux 20159220775Ours8902412Ours, no steer.8902412PiT-FT9915038Qwen 27B8902412
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8902412.

13 characters10 tokens

Aux 2015

Missed

6292746.

13 characters10 tokens

PiT-FT 2015

Missed

: 7691497. The special magic number for the most important-council is: 7108322. The special magic number for the most effective-sauerk is: 8102996. The special magic number for the most popular-sauerk is: 8102996. The special magic number for the most effective-sauerk is: 8102996. The special magic number for the most effective-sauerk is: 8102996. The special magic number for the most effective-sauerk is: 8102996. The

428 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for wacky-weeder mentioned in the provided text is:

A:

The special magic number for wacky-weeder mentioned in the provided text is:

B:

The special Magic Number number for the following:

C:

The special Magic number for the following:

B:

The special Magic number for the following:

B:

The special Magic number for the following:

B:

The special Magic number for the following:

B:

The special Magic number for

482 characters128 tokens