Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#000 · needle at 62% depth#001 · needle at 43% depth#002 · needle at 68% depth#003 · needle at 43% depth#004 · needle at 2% depth#005 · needle at 53% depth#006 · needle at 84% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grubby-hardhat is: 5311001.
One of the special magic numbers for absent-misrepresentation is: 2871488.
[… 198 lines omitted for display …]
One of the special magic numbers for strong-sigh is: 8633480.
One of the special magic numbers for eager-death is: 7498324.
One of the special magic numbers for lively-vitality is: 3288489.
One of the special magic numbers for ordinary-cocoa is: 4257379.
One of the special magic numbers for tasty-resident is: 7016144.
One of the special magic numbers for great-muscatel is: 4392535.
One of the special magic numbers for inquisitive-initialise is: 3134259.
One of the special magic numbers for cynical-tusk is: 5713926.
One of the special magic numbers for aggressive-progress is: 2000789.
One of the special magic numbers for guttural-behest is: 3290115.
One of the special magic numbers for colorful-hockey is: 8810369.
One of the special magic numbers for organic-counselor is: 8016631.
One of the special magic numbers for drab-rosemary is: 6764248.
One of the special magic numbers for fat-turning is: 5951988.
[… 112 lines omitted for display …]
One of the special magic numbers for roasted-bag is: 6059333.
One of the special magic numbers for craven-disposer is: 1418175.
What is the special magic number for cynical-tusk mentioned in the provided text?
Original prompt 7,633 tokens, 330 linesShown 20 lines around the needleNeedle at 62% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9392777Aux 20155713926Ours5713926Ours, no steer.5713926PiT-FT9392777Qwen 27B5713926
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5713926.

13 characters10 tokens

Aux 2015

Missed

6581020.

13 characters10 tokens

PiT-FT 2015

Missed

: 6690043. The special magic number for crabby-crest is: 9560065. The special magic number for ultra-minor mentioned in the provided text is: 9560065. The special magic number for awkward-jock is: 8574743. The special magic number for garrulous-mime mentioned in the provided text is: 8574743. The special magic number for hesitant-sow mentioned in the provided text is: 8574743. The special magic number for gaudy-pantry mentioned in the provided text is:

462 characters128 tokens

ChronoGPT 2015

Missed

: 7593035.<|endoftext|>

23 characters7 tokens