Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#000 · needle at 62% depth#001 · needle at 43% depth#002 · needle at 68% depth#003 · needle at 43% depth#004 · needle at 2% depth#005 · needle at 53% depth#006 · needle at 84% depth#007 · needle at 2% depth#008 · needle at 76% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wise-cornflakes is: 7169641.
One of the special magic numbers for hot-cobweb is: 1353566.
[… 219 lines omitted for display …]
One of the special magic numbers for penitent-doc is: 8077958.
One of the special magic numbers for accidental-wire is: 2953854.
One of the special magic numbers for distinct-incense is: 3557220.
One of the special magic numbers for watchful-aquifer is: 8470322.
One of the special magic numbers for pleasant-veldt is: 8910276.
One of the special magic numbers for acceptable-donor is: 8541631.
One of the special magic numbers for sordid-stumbling is: 5070650.
One of the special magic numbers for laughable-working is: 8972898.
One of the special magic numbers for evanescent-anything is: 5946450.
One of the special magic numbers for skillful-existence is: 7572195.
One of the special magic numbers for aromatic-wiring is: 6601074.
One of the special magic numbers for ablaze-repository is: 2722408.
One of the special magic numbers for tasteful-rhetoric is: 8244199.
One of the special magic numbers for muddy-chorus is: 9316519.
[… 91 lines omitted for display …]
One of the special magic numbers for subdued-abacus is: 3463932.
One of the special magic numbers for warm-comportment is: 7776956.
What is the special magic number for laughable-working mentioned in the provided text?
Original prompt 7,634 tokens, 330 linesShown 20 lines around the needleNeedle at 68% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2778549Aux 20158972898Ours8972898Ours, no steer.8972898PiT-FT2778549Qwen 27B8972898
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8972898.

13 characters10 tokens

Aux 2015

Missed

7972898.

13 characters10 tokens

PiT-FT 2015

Missed

: 8705742. The special magic number for awkward-tambourine is: 8705742. The special magic number for jagged-tissue is: 8705742. The special magic number for awkward-tissue is: 8705742. The special magic number for jagged-tissue is: 8705742. The special magic number for awkward-tissue is: 8705742. The special magic number for jagged-tissue is: 8705742. The special magic number for jagged-tissue is: 870

411 characters128 tokens

ChronoGPT 2015

Missed

: 2370851.<|endoftext|>

23 characters6 tokens