Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 77% depth#076 · needle at 76% depth#077 · needle at 80% depth#078 · needle at 25% depth#079 · needle at 55% depth#080 · needle at 85% depth#081 · needle at 97% depth#082 · needle at 42% depth#083 · needle at 5% depth#084 · needle at 52% depth#085 · needle at 75% depth#086 · needle at 2% depth#087 · needle at 58% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for foolish-formamide is: 5673529.
One of the special magic numbers for elegant-pair is: 1492172.
[… 309 lines omitted for display …]
One of the special magic numbers for spooky-chowder is: 5157063.
One of the special magic numbers for spiritual-hospitalization is: 4739830.
One of the special magic numbers for unadvised-downgrade is: 7532672.
One of the special magic numbers for adaptable-servant is: 7577057.
One of the special magic numbers for warlike-pot is: 3432172.
One of the special magic numbers for narrow-enjoyment is: 4293939.
One of the special magic numbers for ruthless-gall-bladder is: 3476550.
One of the special magic numbers for flashy-paddock is: 2839615.
One of the special magic numbers for standing-notion is: 3303815.
One of the special magic numbers for sordid-townhouse is: 5960542.
One of the special magic numbers for parched-pickup is: 9427131.
One of the special magic numbers for venomous-east is: 8897756.
One of the special magic numbers for guiltless-onion is: 6953815.
One of the special magic numbers for giant-coat is: 7038071.
One of the special magic numbers for salty-east is: 2017386.
One of the special magic numbers for mysterious-appeal is: 1249254.
One of the special magic numbers for empty-opinion is: 3043270.
What is the special magic number for salty-east mentioned in the provided text?
Original prompt 7,656 tokens, 330 linesShown 21 lines around the needleNeedle at 97% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1756953Aux 20152017386Ours2017386Ours, no steer.2017386PiT-FT1756953Qwen 27B2017386
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2017386.

13 characters10 tokens

Aux 2015

Missed

7038071.

13 characters10 tokens

PiT-FT 2015

Missed

: 8803962. The special magic number for awkward-turtle is: 8359743. The special magic number for giddy-gripper is: 8211265. The special magic number for lovable-sock is: 8693070. The special magic number for testy-tissue is: 8703572. The special magic number for anxious-tire is: 8703572. The special magic number for lovable-cactus is: 8703572. The special magic number for giddy-sock is: 870

400 characters128 tokens

ChronoGPT 2015

Missed

: 6351314.<|endoftext|>

23 characters7 tokens