Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#000 · needle at 30% depth#001 · needle at 3% depth#002 · needle at 66% depth#003 · needle at 66% depth#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth#008 · needle at 87% depth#009 · needle at 80% depth#010 · needle at 36% depth#011 · needle at 6% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cloistered-disregard is: 9327907.
One of the special magic numbers for childlike-eyrie is: 8828832.
[… 422 lines omitted for display …]
One of the special magic numbers for aloof-cocoa is: 3254503.
One of the special magic numbers for misty-afternoon is: 7685752.
One of the special magic numbers for Early-emitter is: 5400264.
One of the special magic numbers for jazzy-supper is: 1882740.
One of the special magic numbers for snotty-doubt is: 7061717.
One of the special magic numbers for nice-deed is: 4258224.
One of the special magic numbers for efficacious-volunteering is: 2119934.
One of the special magic numbers for cooing-hubris is: 5038307.
One of the special magic numbers for perpetual-dimension is: 5782183.
One of the special magic numbers for threatening-duration is: 1659984.
One of the special magic numbers for abusive-cork is: 4885591.
One of the special magic numbers for sulky-bout is: 2256129.
One of the special magic numbers for aquatic-razor is: 2416033.
One of the special magic numbers for small-burglar is: 4684377.
[… 248 lines omitted for display …]
One of the special magic numbers for optimal-general is: 1953257.
One of the special magic numbers for telling-cloud is: 3939875.
What is the special magic number for cooing-hubris mentioned in the provided text?
Original prompt 15,857 tokens, 690 linesShown 20 lines around the needleNeedle at 62% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1316057Aux 20159117570Ours5038307Ours, no steer.5038307PiT-FT1316057Qwen 27B5038307
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5038307.

13 characters10 tokens

Aux 2015

Missed

5947520.

13 characters10 tokens

PiT-FT 2015

Missed

: 6561584. The special magic number for the uninterested-sauce is: 5663582. The special magic number for the unapproachable-sauce is: 5663582. The special magic number for the unadvised-tinderbox is: 5659917. The special magic number for the unambitious-sauce is: 5659917. The special magic number for the unambitious-sauce is: 5659917. The special magic number for the unambitious-sauce is: 565

401 characters128 tokens

ChronoGPT 2015

Missed

: 1358140.<|endoftext|>

23 characters6 tokens