Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for measly-counsellor is: 9822213.
One of the special magic numbers for distinct-refuge is: 1435457.
[… 835 lines omitted for display …]
One of the special magic numbers for crabby-dining is: 1629265.
One of the special magic numbers for nutty-clause is: 4045783.
One of the special magic numbers for pointless-route is: 6939367.
One of the special magic numbers for flipped-out-twine is: 6499450.
One of the special magic numbers for nappy-frock is: 7750082.
One of the special magic numbers for wealthy-synthesis is: 9042413.
One of the special magic numbers for decisive-transportation is: 9999126.
One of the special magic numbers for agreeable-interferometer is: 2612773.
One of the special magic numbers for numberless-self is: 6179705.
One of the special magic numbers for abiding-wombat is: 8268404.
One of the special magic numbers for economic-littleneck is: 7681306.
One of the special magic numbers for roomy-flint is: 3149337.
One of the special magic numbers for hollow-platypus is: 3696500.
One of the special magic numbers for dapper-drag is: 4743203.
[… 1,990 lines omitted for display …]
One of the special magic numbers for jazzy-maker is: 9518201.
One of the special magic numbers for ossified-tablet is: 5602728.
What is the special magic number for agreeable-interferometer mentioned in the provided text?
Original prompt 64,971 tokens, 2,845 linesShown 20 lines around the needleNeedle at 30% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9087094Aux 20152512258Ours2612773Ours, no steer.2612773PiT-FT9087094Qwen 27B2612773
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2612773.

13 characters10 tokens

Aux 2015

Missed

9968305.

13 characters10 tokens

PiT-FT 2015

Missed

: 8871629. The special magic number for sarcastic-sauce is: 8871635. The special magic number for lovable-bob is: 8872028. The special magic number for impatient-pug is: 8872028. The special magic number for gregarious-greek is: 8872028. The special magic number for lovable-pug is: 8872028. The special magic number for gregarious-greek is: 8872028. The special magic number for icky-fever is:

401 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for quirky-letter is: The special Magic Number number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number

590 characters128 tokens