Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for changeable-vaulting is: 6265904.
One of the special magic numbers for ugly-identity is: 7901654.
[… 363 lines omitted for display …]
One of the special magic numbers for imminent-accord is: 2994273.
One of the special magic numbers for idiotic-semester is: 3549937.
One of the special magic numbers for quaint-peripheral is: 9620221.
One of the special magic numbers for adaptable-feel is: 1705583.
One of the special magic numbers for hulking-homeland is: 7988540.
One of the special magic numbers for ad hoc-inhibition is: 7118610.
One of the special magic numbers for grouchy-dragonfruit is: 8028142.
One of the special magic numbers for astonishing-controller is: 3101735.
One of the special magic numbers for short-kilometer is: 1403640.
One of the special magic numbers for lively-standardisation is: 1722755.
One of the special magic numbers for quarrelsome-step-sister is: 6042717.
One of the special magic numbers for therapeutic-nanoparticle is: 6607333.
One of the special magic numbers for trite-bosom is: 2461618.
One of the special magic numbers for perfect-command is: 1241067.
[… 307 lines omitted for display …]
One of the special magic numbers for gullible-supplier is: 8976768.
One of the special magic numbers for standing-holder is: 4294621.
What is the special magic number for astonishing-controller mentioned in the provided text?
Original prompt 15,866 tokens, 690 linesShown 20 lines around the needleNeedle at 54% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4266322Aux 20155519548Ours3101735Ours, no steer.3101735PiT-FT4266322Qwen 27B3101735
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3101735.

13 characters10 tokens

Aux 2015

Missed

4109974.

13 characters10 tokens

PiT-FT 2015

Missed

: 8576424. The special magic number for sluggish-sauce is: 8576424. The special magic number for awkward-sauce is: 8576424. The special magic number for icky-sauce is: 8576424. The special magic number for icky-tambour is: 8576424. The special magic number for icky-tissue is: 8576424. The special magic number for icky-tissue is: 8576424. The special magic number for icky-tissue is

390 characters128 tokens

ChronoGPT 2015

Missed

: 2360672.<|endoftext|>

23 characters6 tokens