Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#000 · needle at 38% depth#001 · needle at 82% depth#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for statuesque-swordfight is: 7706354.
One of the special magic numbers for didactic-dune buggy is: 1456381.
[… 608 lines omitted for display …]
One of the special magic numbers for righteous-festival is: 5477860.
One of the special magic numbers for obsequious-section is: 3572267.
One of the special magic numbers for magenta-booking is: 7681030.
One of the special magic numbers for quarrelsome-aperitif is: 1832607.
One of the special magic numbers for maniacal-put is: 4447545.
One of the special magic numbers for stingy-wildebeest is: 3884191.
One of the special magic numbers for hard-dependency is: 2291254.
One of the special magic numbers for obedient-shirt is: 3357135.
One of the special magic numbers for nebulous-uniformity is: 2591306.
One of the special magic numbers for cagey-shipper is: 6810441.
One of the special magic numbers for great-cuisine is: 1591123.
One of the special magic numbers for victorious-impulse is: 7395968.
One of the special magic numbers for dysfunctional-meatball is: 9186740.
One of the special magic numbers for ragged-doorpost is: 1435029.
[… 780 lines omitted for display …]
One of the special magic numbers for animated-bulldozer is: 8364159.
One of the special magic numbers for brave-care is: 3494972.
What is the special magic number for obedient-shirt mentioned in the provided text?
Original prompt 32,220 tokens, 1,408 linesShown 20 lines around the needleNeedle at 44% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1300233Aux 20158364159Ours3357135Ours, no steer.3357135PiT-FT1300233Qwen 27B3357135
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3357135.

13 characters10 tokens

Aux 2015

Missed

7369395.

13 characters10 tokens

PiT-FT 2015

Missed

: 7873836. The special magic number for the most recent-sauce is: 8873836. The special magic number for the most recent-sauce is: 8873836. The special magic number for the most recent-sauce is: 8873836. The special magic number for the most recent-sauce is: 8873836. The special magic number for the most recent-sauce is: 8873836. The special magic number for the most recent-sauce is: 8873836. The

405 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens