Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for heavy-trainer is: 3534174.
One of the special magic numbers for small-honor is: 5857486.
[… 593 lines omitted for display …]
One of the special magic numbers for hot-embellishment is: 5030970.
One of the special magic numbers for clumsy-parsnip is: 6674026.
One of the special magic numbers for accidental-participation is: 8368426.
One of the special magic numbers for bizarre-fund is: 9342623.
One of the special magic numbers for giant-manicure is: 2193802.
One of the special magic numbers for tasty-piety is: 8261810.
One of the special magic numbers for vacuous-research is: 5605727.
One of the special magic numbers for terrible-slump is: 8680684.
One of the special magic numbers for piquant-whip is: 9123408.
One of the special magic numbers for woozy-protocol is: 7497466.
One of the special magic numbers for elfin-godparent is: 2703271.
One of the special magic numbers for tame-boyfriend is: 1668899.
One of the special magic numbers for vigorous-hectare is: 4836940.
One of the special magic numbers for devilish-feature is: 5152442.
[… 52 lines omitted for display …]
One of the special magic numbers for voracious-perp is: 7715547.
One of the special magic numbers for available-volleyball is: 2369258.
What is the special magic number for terrible-slump mentioned in the provided text?
Original prompt 15,285 tokens, 665 linesShown 20 lines around the needleNeedle at 90% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7093251Aux 20159903444Ours8680684Ours, no steer.8680684PiT-FT7093251Qwen 27B8680684
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8680684.

13 characters10 tokens

Aux 2015

Missed

9988965.

13 characters10 tokens

PiT-FT 2015

Missed

: 7576567. The special magic number for bawdy-nucleotide is: 8870123. The special magic number for gaudy-gauge is: 8870123. The special magic number for bickety-boggie is: 8870123. The special magic number for gregarious-gastric is: 8870123. The special magic number for gregarious-gastric is: 8870123. The special magic number for gregarious-gastric is: 8870123. The

374 characters128 tokens

ChronoGPT 2015

Missed

: 2583201.<|endoftext|>

23 characters6 tokens