Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth#099 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wiry-discourse is: 4306162.
One of the special magic numbers for relieved-self-control is: 2584062.
[… 290 lines omitted for display …]
One of the special magic numbers for lively-hydrocarb is: 5007122.
One of the special magic numbers for ugly-plaintiff is: 8377956.
One of the special magic numbers for greedy-curtailment is: 1717739.
One of the special magic numbers for spicy-graph is: 6527801.
One of the special magic numbers for plausible-amazement is: 7526448.
One of the special magic numbers for hallowed-yolk is: 6036624.
One of the special magic numbers for futuristic-motivation is: 9215653.
One of the special magic numbers for fine-dispute is: 7006456.
One of the special magic numbers for helpless-topsail is: 3929989.
One of the special magic numbers for tall-talking is: 1671419.
One of the special magic numbers for modern-jicama is: 1559853.
One of the special magic numbers for blushing-cascade is: 3508876.
One of the special magic numbers for rough-amusement is: 3597104.
One of the special magic numbers for tall-pear is: 6495667.
[… 380 lines omitted for display …]
One of the special magic numbers for ruddy-ficlet is: 2509951.
One of the special magic numbers for ubiquitous-removal is: 2657066.
What is the special magic number for fine-dispute mentioned in the provided text?
Original prompt 15,857 tokens, 690 linesShown 20 lines around the needleNeedle at 43% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6982669Aux 20151660234Ours7006456Ours, no steer.7006456PiT-FT6982669Qwen 27B7006456
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7006456.

13 characters10 tokens

Aux 2015

Missed

4412823.

13 characters10 tokens

PiT-FT 2015

Missed

: 8672061. The special magic number for the most popular-bobcat is: 8572061. The special magic number for the most popular-bongo is: 8703513. The special magic number for the most popular-banyan is: 8703513. The special magic number for the most popular-banyan is: 8703513. The special magic number for the most popular-banyan is: 8703513. The special magic number for the most popular-banyan is: 8703513. The special

424 characters128 tokens

ChronoGPT 2015

Missed

: 5851580.<|endoftext|>

23 characters7 tokens