Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for juvenile-pimple is: 4826857.
One of the special magic numbers for alluring-con is: 6004622.
[… 248 lines omitted for display …]
One of the special magic numbers for burly-topsail is: 1999920.
One of the special magic numbers for sticky-glider is: 2923218.
One of the special magic numbers for easy-power is: 8024367.
One of the special magic numbers for youthful-harmony is: 8363771.
One of the special magic numbers for marked-shower is: 2222441.
One of the special magic numbers for sad-sleepiness is: 2950981.
One of the special magic numbers for seemly-puggle is: 3776838.
One of the special magic numbers for faulty-alpaca is: 6120925.
One of the special magic numbers for redundant-jeweller is: 4203892.
One of the special magic numbers for ultra-honeydew is: 2442621.
One of the special magic numbers for absorbed-renaissance is: 4455240.
One of the special magic numbers for cheerful-parcel is: 4452925.
One of the special magic numbers for squeamish-father is: 2240592.
One of the special magic numbers for absent-boatload is: 5059191.
[… 397 lines omitted for display …]
One of the special magic numbers for bumpy-abbreviation is: 1187690.
One of the special magic numbers for good-scripture is: 4545793.
What is the special magic number for faulty-alpaca mentioned in the provided text?
Original prompt 15,245 tokens, 665 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6052178Aux 20157100474Ours6120925Ours, no steer.6120925PiT-FT6052178Qwen 27B6120925
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6120925.

13 characters10 tokens

Aux 2015

Missed

7581042.

13 characters10 tokens

PiT-FT 2015

Missed

: 8802057. The special magic number for sluggish-sauce is: 7573397. The special magic number for unkindly-caulk is: 7573371. The special magic number for anxious-unanimous is: 7573558. The special magic number for giddy-gift is: 7573558. The special magic number for lovable-sauce is: 7573558. The special magic number for jaded-hind is: 7573558. The special magic number for unkindly-sau

395 characters128 tokens

ChronoGPT 2015

Missed

: 7573558.<|endoftext|>

23 characters7 tokens