Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth#096 · needle at 5% depth#097 · needle at 62% depth#098 · needle at 89% depth#099 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for breakable-prayer is: 1567624.
One of the special magic numbers for seemly-respect is: 1065657.
[… 435 lines omitted for display …]
One of the special magic numbers for tough-glance is: 6594528.
One of the special magic numbers for tired-folklore is: 1841608.
One of the special magic numbers for boiling-ex-wife is: 4419533.
One of the special magic numbers for teeny-tiny-menorah is: 6564128.
One of the special magic numbers for lucky-mound is: 3290534.
One of the special magic numbers for curious-myth is: 8082060.
One of the special magic numbers for grieving-parent is: 5180203.
One of the special magic numbers for aggressive-dipstick is: 9217299.
One of the special magic numbers for grandiose-barley is: 5837411.
One of the special magic numbers for meek-lantern is: 1764484.
One of the special magic numbers for warlike-capitalism is: 2080779.
One of the special magic numbers for icky-tin is: 6958811.
One of the special magic numbers for shiny-golf is: 7966842.
One of the special magic numbers for rapid-dare is: 6780421.
[… 953 lines omitted for display …]
One of the special magic numbers for pumped-decimal is: 9605429.
One of the special magic numbers for furtive-thump is: 5256237.
What is the special magic number for aggressive-dipstick mentioned in the provided text?
Original prompt 32,231 tokens, 1,408 linesShown 20 lines around the needleNeedle at 32% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4803794Aux 20152678756Ours9217299Ours, no steer.9217299PiT-FT4803794Qwen 27B9217299
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9217299.

13 characters10 tokens

Aux 2015

Missed

8106185.

13 characters10 tokens

PiT-FT 2015

Missed

: 7581332. The special magic number for the most recent-tune is: 8012068. The special magic number for the most recent-tune is: 8012068. The special magic number for the most recent-tune is: 8012068. The special magic number for the most recent-tune is: 8012068. The special magic number for the most recent-tune is: 8012068. The special magic number for the most recent-tune is: 8012068. The special magic number for the most

433 characters128 tokens

ChronoGPT 2015

Missed

: 1813491.<|endoftext|>

23 characters6 tokens