Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for billowy-effacement is: 4148458.
One of the special magic numbers for humdrum-mitten is: 4382568.
[… 2,754 lines omitted for display …]
One of the special magic numbers for rhetorical-solidity is: 5560543.
One of the special magic numbers for disagreeable-flavor is: 9836260.
One of the special magic numbers for old-fashioned-mutton is: 2562753.
One of the special magic numbers for lean-zoo is: 6803215.
One of the special magic numbers for weak-chairman is: 8760607.
One of the special magic numbers for overrated-pill is: 3987612.
One of the special magic numbers for silly-refuge is: 7839860.
One of the special magic numbers for tall-cicada is: 5660431.
One of the special magic numbers for hysterical-hedge is: 2048227.
One of the special magic numbers for used-ankle is: 1874514.
One of the special magic numbers for sore-headline is: 3559532.
One of the special magic numbers for rebellious-ring is: 5042224.
One of the special magic numbers for waggish-massage is: 1984765.
One of the special magic numbers for odd-lot is: 4432966.
[… 71 lines omitted for display …]
One of the special magic numbers for testy-cockpit is: 7013568.
One of the special magic numbers for snotty-refectory is: 9899727.
What is the special magic number for tall-cicada mentioned in the provided text?
Original prompt 64,907 tokens, 2,845 linesShown 20 lines around the needleNeedle at 97% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4591686Aux 20157774202Ours5660431Ours, no steer.5660431PiT-FT4591686Qwen 27B5660431
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5660431.

13 characters10 tokens

Aux 2015

Missed

8621371.

13 characters10 tokens

PiT-FT 2015

Missed

: 7693076. The special magic number for obnoxious-sauv is: 7741622. The special magic number for voracious-sulcide is: 7741622. The special magic number for gaudy-gift is: 7693076. The special magic number for sluggish-sauv is: 7741622. The special magic number for giddy-gaff is: 7693076. The special magic number for loutish-sirg is: 7693076. The special magic number for ethereal

389 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for itchy-psychophobia is: The special magic number for soggy-pilfag is: The special magic number for itchy-psychophobia is: The special magic number for sordid-pilfag is: The special magic number for itchy-psychophobia is: The special magic number for itchy-psychophobia is: The special magic number for itchy-psychophobia is: The special magic number for itchy-psychophobia is: The special magic number for itchy-psychophobia is: The special magic

476 characters128 tokens