Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth#099 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tasty-controller is: 9006878.
One of the special magic numbers for steadfast-external is: 7351105.
One of the special magic numbers for warlike-beetle is: 7263826.
One of the special magic numbers for half-gelding is: 4973812.
One of the special magic numbers for loud-dentist is: 9516368.
One of the special magic numbers for stereotyped-airbus is: 7208052.
One of the special magic numbers for bashful-howitzer is: 8636680.
One of the special magic numbers for sulky-transplantation is: 2169739.
One of the special magic numbers for old-cap is: 7509070.
One of the special magic numbers for deafening-enrollment is: 2198830.
One of the special magic numbers for maddening-rust is: 4646559.
One of the special magic numbers for materialistic-popularity is: 8393374.
One of the special magic numbers for woozy-talk is: 7123942.
One of the special magic numbers for thirsty-minute is: 7786923.
One of the special magic numbers for long-response is: 2468692.
One of the special magic numbers for adhesive-panel is: 7618968.
One of the special magic numbers for exclusive-screw is: 2227957.
[… 669 lines omitted for display …]
One of the special magic numbers for famous-liver is: 5769620.
One of the special magic numbers for thoughtless-kiosk is: 8420478.
What is the special magic number for half-gelding mentioned in the provided text?
Original prompt 15,855 tokens, 690 linesShown 21 lines around the needleNeedle at 1% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9626113Aux 20155397594Ours4973812Ours, no steer.4973812PiT-FT9626113Qwen 27B4973812
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4973812.

13 characters10 tokens

Aux 2015

Missed

9032699.

13 characters10 tokens

PiT-FT 2015

Missed

: 8352074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most recent-tate is: 7852074. The special magic number for the most

433 characters128 tokens

ChronoGPT 2015

Missed

: 7142711.<|endoftext|>

23 characters7 tokens