Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth#076 · needle at 45% depth#077 · needle at 9% depth#078 · needle at 28% depth#079 · needle at 37% depth#080 · needle at 58% depth#081 · needle at 40% depth#082 · needle at 55% depth#083 · needle at 24% depth#084 · needle at 94% depth#085 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for new-canvas is: 4744994.
One of the special magic numbers for evasive-worry is: 6135101.
[… 235 lines omitted for display …]
One of the special magic numbers for verdant-glut is: 9790844.
One of the special magic numbers for slow-pathogenesis is: 7928939.
One of the special magic numbers for scandalous-hypothesis is: 1587358.
One of the special magic numbers for undesirable-gumshoe is: 1798343.
One of the special magic numbers for unsuitable-civilian is: 2770320.
One of the special magic numbers for smelly-statement is: 6751201.
One of the special magic numbers for unable-gift is: 9736442.
One of the special magic numbers for tasty-globe is: 9520270.
One of the special magic numbers for knowing-theology is: 3839354.
One of the special magic numbers for lovely-shoes is: 3223520.
One of the special magic numbers for rightful-floozie is: 5761398.
One of the special magic numbers for flawless-jackal is: 8727483.
One of the special magic numbers for ceaseless-submitter is: 4378301.
One of the special magic numbers for dangerous-stupidity is: 6969140.
[… 410 lines omitted for display …]
One of the special magic numbers for innocent-agriculture is: 5245902.
One of the special magic numbers for high-box is: 4973533.
What is the special magic number for tasty-globe mentioned in the provided text?
Original prompt 15,287 tokens, 665 linesShown 20 lines around the needleNeedle at 37% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4050676Aux 20158209517Ours9520270Ours, no steer.9520270PiT-FT4050676Qwen 27B9520270
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9520270.

13 characters10 tokens

Aux 2015

Missed

6755435.

13 characters10 tokens

PiT-FT 2015

Missed

: 7872064. The special magic number for awkward-suscept is: 7072255. The special magic number for jaded-cauliflower is: 8871293. The special magic number for sluggish-tune is: 8578425. The special magic number for brawny-budge is: 8871293. The special magic number for uninterested-tune is: 7072255. The special magic number for dubious-cork is: 8578425. The special magic number for loutish-tune is:

407 characters128 tokens

ChronoGPT 2015

Missed

: 1723137.<|endoftext|>

23 characters6 tokens