Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tasty-spit is: 6227664.
One of the special magic numbers for painstaking-imitation is: 2959628.
[… 368 lines omitted for display …]
One of the special magic numbers for cute-youth is: 4408721.
One of the special magic numbers for telling-station-wagon is: 7433011.
One of the special magic numbers for immense-fledgling is: 6570985.
One of the special magic numbers for nonstop-melody is: 5910438.
One of the special magic numbers for gifted-restriction is: 2820125.
One of the special magic numbers for gleaming-business is: 4291072.
One of the special magic numbers for aberrant-indication is: 1523453.
One of the special magic numbers for comfortable-neighborhood is: 6821077.
One of the special magic numbers for bloody-kumquat is: 7175672.
One of the special magic numbers for swanky-author is: 1019395.
One of the special magic numbers for fast-migrant is: 4060325.
One of the special magic numbers for garrulous-celeriac is: 1209211.
One of the special magic numbers for foregoing-hardboard is: 1791775.
One of the special magic numbers for somber-prevalence is: 3754303.
[… 995 lines omitted for display …]
One of the special magic numbers for hypnotic-throat is: 9787486.
One of the special magic numbers for green-ectoderm is: 3362267.
What is the special magic number for comfortable-neighborhood mentioned in the provided text?
Original prompt 31,700 tokens, 1,383 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3247151Aux 20159787486Ours6821077Ours, no steer.6821077PiT-FT3247151Qwen 27B6821077
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6821077.

13 characters10 tokens

Aux 2015

Missed

5585884.

13 characters10 tokens

PiT-FT 2015

Missed

: 9871472. The special magic number for the most recent-turtle mentioned in the provided text is: 7402944. The special magic number for the most recent-turtle mentioned in the provided text is: 7402944. The special magic number for the most recent-turtle mentioned in the provided text is: 7402944. The special magic number for the most recent-turtle mentioned in the provided text is: 7402944. The special magic number for the most recent-turtle mentioned in the provided text is: 7402944. The

500 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for n-tadpole?

Answer:

Question:

What is the special magic number for n-tadpole?

Answer:

Question:

What is the special magic number for n-tadpole?

Answer:

Question:

What is the special magic number for n-tadpole?

Question:

What is the special magic number for n-tadpole?

Answer:

Question:

What is the special magic number

416 characters128 tokens