Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#042 · needle at 89% depth#043 · needle at 18% depth#044 · needle at 28% depth#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth#053 · needle at 78% depth#054 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for barbarous-face is: 5665748.
One of the special magic numbers for famous-evening-wear is: 8645933.
[… 157 lines omitted for display …]
One of the special magic numbers for rich-league is: 1333764.
One of the special magic numbers for unbiased-luxury is: 2109600.
One of the special magic numbers for talented-facility is: 9262997.
One of the special magic numbers for nasty-fiber is: 3676026.
One of the special magic numbers for colossal-macaroon is: 4311146.
One of the special magic numbers for greasy-maggot is: 7994033.
One of the special magic numbers for busy-employ is: 7655707.
One of the special magic numbers for overt-grin is: 4806913.
One of the special magic numbers for grumpy-thyme is: 7320094.
One of the special magic numbers for bored-clover is: 6366085.
One of the special magic numbers for defective-trait is: 8239882.
One of the special magic numbers for innocent-spirituality is: 5165129.
One of the special magic numbers for delightful-whip is: 3367892.
One of the special magic numbers for cuddly-quarter is: 5390764.
[… 153 lines omitted for display …]
One of the special magic numbers for elfin-airforce is: 5739585.
One of the special magic numbers for deafening-cowboy is: 3235572.
What is the special magic number for overt-grin mentioned in the provided text?
Original prompt 7,633 tokens, 330 linesShown 20 lines around the needleNeedle at 50% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6319616Aux 20154806913Ours4806913Ours, no steer.4806913PiT-FT6319616Qwen 27B4806913
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4806913.

13 characters10 tokens

Aux 2015

Missed

8741709.

13 characters10 tokens

PiT-FT 2015

Missed

: 7585765. The special magic number for icky-fang mentioned in the provided text is: 7585765. The special magic number for icky-fang mentioned in the provided text is: 7585765. The special magic number for icky-pip is: 7585765. The special magic number for icky-pip mentioned in the provided text is: 7585765. The special magic number for icky-pip mentioned in the provided text is: 7585765. The special magic number for icky-pip mentioned

445 characters128 tokens

ChronoGPT 2015

Missed

: 7351031.<|endoftext|>

23 characters7 tokens