Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bright-repository is: 3976049.
One of the special magic numbers for stale-candidacy is: 3675526.
[… 29 lines omitted for display …]
One of the special magic numbers for squeamish-elicit is: 7104201.
One of the special magic numbers for didactic-coinsurance is: 4274026.
One of the special magic numbers for vivacious-put is: 5274432.
One of the special magic numbers for equable-bolt is: 5503800.
One of the special magic numbers for quizzical-badge is: 1560708.
One of the special magic numbers for capricious-protocol is: 4250421.
One of the special magic numbers for gaudy-clue is: 4884216.
One of the special magic numbers for unequaled-brassiere is: 8598830.
One of the special magic numbers for billowy-appeal is: 5174882.
One of the special magic numbers for faulty-liquidity is: 9609817.
One of the special magic numbers for quarrelsome-switchboard is: 1907223.
One of the special magic numbers for enchanting-telescreen is: 2943244.
One of the special magic numbers for cautious-slide is: 7373069.
[… 2,797 lines omitted for display …]
One of the special magic numbers for jumbled-empire is: 2123845.
One of the special magic numbers for moaning-difficulty is: 9945542.
What is the special magic number for gaudy-clue mentioned in the provided text?
Original prompt 64,954 tokens, 2,845 linesShown 19 lines around the needleNeedle at 1% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1362132Aux 20154931052Ours4884216Ours, no steer.4884216PiT-FT1362132Qwen 27B4884216
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4884216.

13 characters10 tokens

Aux 2015

Missed

3511205.

13 characters10 tokens

PiT-FT 2015

Missed

: 7586778. The special magic number for the most important-babylon is: 8570032. The special magic number for the most effective-babylon is: 8570032. The special magic number for the most beautiful-babylon is: 8570032. The special magic number for the most effective-sap is: 8102811. The special magic number for the most effective-sauce is: 8102811. The special magic number for the most effective-sorgh is: 8102811. The special

435 characters128 tokens

ChronoGPT 2015

Missed

: Rounding-rabbit is the special magic number for rambunctious-bacterium mentioned in the provided text is: Rounding-penguin is the special Magic Number for the special Magic number for the sable-nest is: Rounding-penguin is the special Magic number for the sable-nest is: Rounding-penguin is the special Magic number for the sable-nest is: Rounding-penguin is the special Magic number for the sable-nest is: Rounding-penguin is the special Magic

446 characters128 tokens