Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for knotty-willingness is: 9151696.
One of the special magic numbers for pointless-wasting is: 6764560.
[… 28 lines omitted for display …]
One of the special magic numbers for productive-perfection is: 1515611.
One of the special magic numbers for malicious-fibrosis is: 8690681.
One of the special magic numbers for lean-meatloaf is: 2508791.
One of the special magic numbers for imperfect-clarinet is: 4746685.
One of the special magic numbers for juicy-critic is: 1669085.
One of the special magic numbers for fine-ape is: 5840215.
One of the special magic numbers for joyous-consul is: 2711934.
One of the special magic numbers for rural-bowling is: 7580380.
One of the special magic numbers for halting-roster is: 4032769.
One of the special magic numbers for volatile-gunpowder is: 5674817.
One of the special magic numbers for peaceful-display is: 5243276.
One of the special magic numbers for gamy-standing is: 5271530.
One of the special magic numbers for wealthy-ivory is: 5283908.
One of the special magic numbers for magenta-sanctuary is: 6986757.
[… 2,772 lines omitted for display …]
One of the special magic numbers for quaint-missile is: 5921966.
One of the special magic numbers for tangy-gel is: 2897199.
What is the special magic number for rural-bowling mentioned in the provided text?
Original prompt 64,395 tokens, 2,820 linesShown 20 lines around the needleNeedle at 1% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1980425Aux 20155735054Ours7580380Ours, no steer.7580380PiT-FT1980425Qwen 27B7580380
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7580380.

13 characters10 tokens

Aux 2015

Missed

2323572.

13 characters10 tokens

PiT-FT 2015

Missed

: 7109637. The special magic number for sluggish-sauce is: 7109637. The special magic number for gaudy-gift is: 7109637. The special magic number for icky-nun is: 7109637. The special magic number for gassy-grav is: 7109637. The special magic number for icky-sauce is: 7109637. The special magic number for loutish-cav is: 7109637. The special magic number for icky-sau

376 characters128 tokens

ChronoGPT 2015

Missed

: The special Magic Number number for the rambunctious-polarization is: The special Magic number for the rambunctious-polarization is: The special Magic number for the rambunctious-polarization is: The special Magic number for the rambunctious-pantobier is: The special Magic number for the rambunctious-papaya is: The special Magic number for the rambunctious-papaya is: The special Magic number for the rambunctious-papaya is: The special Magic number for

457 characters128 tokens