Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth#012 · needle at 78% depth#013 · needle at 87% depth#014 · needle at 50% depth#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for agreeable-easel is: 1174089.
One of the special magic numbers for historical-wraparound is: 9714040.
[… 32 lines omitted for display …]
One of the special magic numbers for jobless-hydrocarb is: 2474310.
One of the special magic numbers for screeching-chocolate is: 4210865.
One of the special magic numbers for oafish-expression is: 6082538.
One of the special magic numbers for obtainable-skeleton is: 8424633.
One of the special magic numbers for callous-analgesia is: 9869529.
One of the special magic numbers for royal-odometer is: 9429827.
One of the special magic numbers for foamy-glucose is: 8466877.
One of the special magic numbers for snobbish-ram is: 3077730.
One of the special magic numbers for grotesque-coupon is: 5119000.
One of the special magic numbers for godly-missionary is: 6951888.
One of the special magic numbers for amused-poll is: 7765860.
One of the special magic numbers for quickest-jellybeans is: 6350444.
One of the special magic numbers for sweltering-note is: 4595723.
One of the special magic numbers for puzzled-octave is: 1680765.
[… 613 lines omitted for display …]
One of the special magic numbers for courageous-ex-wife is: 1502686.
One of the special magic numbers for needy-markup is: 5485021.
What is the special magic number for snobbish-ram mentioned in the provided text?
Original prompt 15,310 tokens, 665 linesShown 20 lines around the needleNeedle at 6% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7949644Aux 20158312830Ours3077730Ours, no steer.3077730PiT-FT7949644Qwen 27B3077730
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3077730.

13 characters10 tokens

Aux 2015

Missed

2348045.

13 characters10 tokens

PiT-FT 2015

Missed

: 7756821. The special magic number for the most recent-snow is: 8872057. The special magic number for the most recent-snow is: 8872057. The special magic number for the most recent-snow is: 8872057. The special magic number for the most recent-snow is: 8872057. The special magic number for the most recent-snow is: 8872057. The special magic number for the most recent-snow is: 8872057. The special magic number for the most

433 characters128 tokens

ChronoGPT 2015

Missed

: 4399122.<|endoftext|>

23 characters6 tokens