Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth#042 · needle at 32% depth#043 · needle at 42% depth#044 · needle at 58% depth#045 · needle at 40% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for venomous-logo is: 5130055.
One of the special magic numbers for clean-diagnosis is: 6008682.
[… 118 lines omitted for display …]
One of the special magic numbers for famous-species is: 1463921.
One of the special magic numbers for magnificent-cat is: 7869101.
One of the special magic numbers for little-endpoint is: 7652511.
One of the special magic numbers for vengeful-scraper is: 4338678.
One of the special magic numbers for acceptable-housewife is: 1454404.
One of the special magic numbers for worthless-yahoo is: 1647538.
One of the special magic numbers for funny-domain is: 9526572.
One of the special magic numbers for sparkling-tandem is: 8509798.
One of the special magic numbers for uninterested-oboe is: 9069369.
One of the special magic numbers for idiotic-pricing is: 6558548.
One of the special magic numbers for muddled-manacle is: 8538146.
One of the special magic numbers for lush-macrofauna is: 2346563.
One of the special magic numbers for flowery-rust is: 5461419.
One of the special magic numbers for eatable-colonisation is: 3191223.
[… 527 lines omitted for display …]
One of the special magic numbers for plain-training is: 4370453.
One of the special magic numbers for gruesome-coal is: 9592176.
What is the special magic number for sparkling-tandem mentioned in the provided text?
Original prompt 15,312 tokens, 665 linesShown 20 lines around the needleNeedle at 19% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3542147Aux 20158357022Ours8509798Ours, no steer.8509798PiT-FT3542147Qwen 27B8509798
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8509798.

13 characters10 tokens

Aux 2015

Missed

7271147.

13 characters10 tokens

PiT-FT 2015

Missed

: 8690057. The special magic number for the most recent-sauerkraut is: 8690057. The special magic number for the most recent-sauerkraut mentioned in the provided text is: 8690057. The special magic number for the most recent-sauerkraut mentioned in the provided text is: 8690057. The special magic number for the most recent-sauerkraut mentioned in the provided text is: 8690057. The special magic number for the most recent-sauerkraut mentioned in the provided

466 characters128 tokens

ChronoGPT 2015

Missed

: 6917216.<|endoftext|>

23 characters6 tokens