Experiment 221

“A6.1, part 1: the sampled verdicts of 0120, 0125, 0140, 0142, 0144 and 0146 rerun unchanged from their frozen searches, with every best reading (K4's, the copies', the plants') read by the blind judge instead of quadgrams”

A6.1 (Stage 2, step 4, issue #84). Every sampled close in F1 compared K4's climbed reading with the copies' climbed readings by quadgram score, and the judge bench (reports/judge-bench.md) shows quadgrams find none of the damaged classes against English-like junk, which is what a climb returns on a copy. Here the six verdicts of F1.1 (0120 at 23 and 26, 0140 at 23, 0142 at 26), F1.2 (0144 at 13 and 16, 0146 at 8) and F1.3 (0125) are rejudged: each frozen attack.py is run unchanged with its own seeds (nothing was saved but K4's reading and the copies' scores), its process pool intercepted to keep every job's reading, K4's reading checked against the record, and K4's, the copies' and the in-run plants' best readings read by the judge, one blind call per verdict.

revertedstatus
experiment 140parents
44.0 htime, all phases
4candidates
24/24known letters
1

The experiment method

What the method does with the 24 known letters.

Several earlier experiments could not decide a question exactly, so they let a computer adjust the keythe secret word The word or string a cipher needs besides the method. for the best-looking English on the carved lettersthe carved letters The 97 letters cut into the copper at the CIA, shown at the top of every experiment page. and on scrambled copiesa shuffled control The same experiment run on the carved letters shuffled into a random order. of them, and compared the two with a simple letter-statistics score. That score turned out to be poor at spotting damaged English, with missing words, X's between words or a few wrong letters. Here we rerun those same searches exactly as they were and let the judgethe judge A language model that scores how much of a reading is English, from 0 to 100, allowing misspellings and X between sentences., a language model that reads one text at a time without knowing where it came from, score the carved letters' reading and the copies' readings side by side.

Words in the margin are defined on the glossary page.

1.1

The method at work

The carved letters go in at the top; the reading comes out at the bottom.

OBKRUOXOGHULBSOLIFBBWEASTNORTHEASTOTWTQSJQSSEKZZWATJKLUDIAWINFBBERLINCLOCKWGDKZXTJCDIGKUHUAUEKCAReach verdict rerun from its frozen code and seeds; K4's best reading and every copy's read by the judge, one at a time, unlabelled (0 = random letters, 100 = fluent English)0142 L26020406080100K4 6K4 rank 13 of 130146 L8020406080100K4 8K4 rank 11 of 130125 running key020406080100K4 8K4 rank 42 of 510140 L23020406080100K4 12K4 rank 7 of 130144 L13020406080100K4 8K4 rank 13 of 130144 L16020406080100K4 8K4 rank 13 of 130120 L23020406080100K4 12K4 rank 6 of 130120 L26020406080100K4 8K4 rank 11 of 13copies' best readings (12, or 50 for 0125)planted messages found by the judge: 0125 plants 20 of 20; 0140 plants L26 0 of 6; 0120 plants L23 2 of 6; 0120 plants L26 0 of 6EASTNORTHEASTBERLINCLOCKIN: THE COPPER, ALL 97 LETTERS, THE 24 KNOWN PLACES IN ACCENTOUT: NO READING; K4 ABOVE EVERY COPY IN NONE OF THE 8 VERDICTS
the idea

Earlier verdicts compared K4's climbed reading with the copies' by a letter-statistics score, which is poor at damaged English. The judge reads for words and tolerates X stops and misspellings.

the check

Six frozen searches rerun with their own seeds; every reading came back letter for letter. K4's and the copies' readings judged blind, one call per verdict.

the bound

K4 above every copy in 0 of 8 (chance 0.56). The judge found 20 of 20 planted running keys (quadgrams 11) but only 2 of 18 climbed free-alphabet plants: the climbed readings are about a third right, too little to read.

2

Experiment lineage

What this experiment was built on, from the lineage page: 13 experiments before it, back to the root of its line. Its number is in bold.

kept reverted, in its family's colour ×error or timeout reverted under today's rules built on a parent in the same family built on a parent in another family
3

Best candidate against the known letters

Laid out as the copper carries K4: OBKR ends the line that finishes K3, then three lines of 31. Left, as carved, the 24 known places in accent. Right, the candidate: a known place it gets right is an accent cell, one it misses is outlined. This is the candidate with most known letters right; none passed every gate.

in: the copper, always the same

as carved, 97 letters; the 24 known places in accent
ECDMRIPFEIMEHNLSSTTRTVDOHW?OBKR
UOXOGHULBSOLIFBBWFLRVQQPRNGKSSO
TWTQSJQSSEKZZWATJKLUDIAWINFBNYP
VTTMZFPKWGDKZXTJCDIGKUHUAUEKCAR

OBKR ends the line that finishes K3, then three lines of 31

out: the candidate

every place read; known places in accent, misses outlined
ECDMRIPFEIMEHNLSSTTRTVDOHW?WRYZ
NNIPNMUPTOMEORJZEEASTNORTHEASTR
BYEASILETFIPLSNGESMUCHASTDCEBER
LINCLOCKHASANDWLANDWOHLUCEKSENP

checked: the known letters in place, and the reading turns back into the copper

4

How the score is made

The loss of the best candidate, part by part. Zero is solved.

Known letters missed0 of 24, ten points each0.00
Englishthe 73 free letters score -5.81; English text scores -3.62.21
Key205 bits to write it down (key words are cheap, arbitrary letters 4.7 bits each); each 60 beyond 60 costs a point2.42
Lossof 240, the worst possible4.63 1.9%
5

Walkthrough, by hand

Redo the method on a few letters with pencil and paper.

  1. Take one earlier verdict, say 0140: K4 and 12 scrambled copies, each with a key climbed for English.
  2. Rerun that exact search, same random seeds, so every reading comes out as it did.
  3. Check that K4's reading is letter for letter the one in 0140's record.
  4. Hide the 24 known letters in each reading and give the 13 readings to the judge one at a time, unlabelled.
  5. K4 wins the cell only if its score is above all 12 copies' scores.
the worksheet: the first steps by hand, on squared paper
verdictK4copies' bestK4's rankno score0142 L2661513 of 1300146 L881211 of 1300125 running key82242 of 5100140 L2312187 of 1300144 L1381213 of 1300144 L1681813 of 1300120 L2312126 of 1300120 L2682211 of 130Reproduced exactly before judging: K4's reading at every length and the copies' scores, from the frozen code and seeds.EACH SAMPLED VERDICT, REJUDGED: K4'S JUDGE SCORE AGAINST THE COPIES' BEST
6

Worked example, generated

The same steps run by the code on the real letters.

A6.1 rejudges a climbed reading. 0140's reading of K4 at key length 23 (one alphabet, Beaufort form):

  reading      BOARIMELRBCEHINVEHWATEASTNORTHEASTHATEGNANHIFPLLBADIRODMOROSORYBERLINCLOCKDAVARRUNDISHEDSAVEANLAP
  judge sees   BOARIMELRBCEHINVEHWAT#############HATEGNANHIFPLLBADIRODMOROSORY###########DAVARRUNDISHEDSAVEANLAP

  quadgram mean -4.9891, rank 9 of 13 among its own copies
  the judge reads the same 13 readings, one at a time, unlabelled; K4 must score above all 12 copies.
7

Hypothesis, for a cryptanalyst

Family, key space, the constraint under test, and the clues it reads.

A6 and A13 (knowledge/12-assumptions.md): the sampled closes of F1.1 (one free alphabet, Beaufort form, key lengths 23 and 26: 0120, 0140, 0142), F1.2 (two free alphabets, lengths 8, 13, 16: 0144, 0146) and F1.3 (a running key from an unknown English text on the 208,062 dictionary tables: 0125) rest on the quadgram mean of a climbed reading. C5 and C27(c) (a keyed alphabet 'slightly different' from KRYPTOS, the K1/K2 system) are the clues those closes read; C19 (X stops, Scheidt 2015) and the bench's damaged classes are why the score is in doubt. Statistic per verdict: the judge's score (j3, Sonnet 5.5, kryptos/judge.py) of K4's best reading against the best of each copy's, copies made by the frozen code (0119's exact decider for 0120/0140/0142, kept-place shuffles for 0144/0146, plain shuffles for 0125), K4 counting only strictly above every copy, None as not found. 0125's reading is the forced running-key stretch (24 letters at 22-34 and 64-74), shown to the judge at places 35-47 and 49-59 with '?' elsewhere so its masking of the known places does not hide it. Eight cells; chance puts K4 above all 12 (50) copies with p = 1/13 (1/51) each, about 0.6 cells in all; a cell flags at p < 0.05 / 8, which needs 160 copies: a K4 above every copy here is a candidate for that replication, not a result.

8

Prediction

Written before the run; the result decides it.

K4's reading scores above every copy's in none of the 8 cells (chance expects 0.6). K4's six saved readings are reproduced exactly. The judge finds at most as many of 0120's and 0140's planted texts as quadgrams did (0120: 3 of 6 at 23, 1 of 6 at 26; 0140: 5 of 6), because their climbed readings are only a third right (29-43 of 97 letters), and at least the 11 of 0125's 20 planted running keys that quadgrams found. Zero candidates pass gate 4.

9

Method

  1. For 0142, 0146, 0125, 0140, 0144, 0120 in that order: load the frozen attack.py and call its run() with the harness's context and a far deadline (every original run finished all its restarts), the process pool replaced by one that runs the same jobs and keeps each job and result.
  2. Check K4's reading equals the record's, and the copies' quadgram scores equal the record's.
  3. Per verdict, one judge call on K4's best reading and every copy's; per plant group, one call on the plants' readings and their own copies'.
  4. K4 counts only strictly above every copy; a plant counts as found by the judge strictly above every copy it was compared with in its experiment (0120: K4's copies at its length; 0140: its own six; 0125: the 50 copies).
10

Result and bounds

The harness's record: candidates, gates, loss, and the negative result this experiment leaves behind.

4candidates returned
0passed every gate
24/24known letters, best
1.7%lowest loss
nonechampion before

All 4 candidates, lowest loss first.

1failed at baseline24/24 known lettersloss 1.7%
ECDMRIPFEIMEHNLSSTTRTVDOHW?BOAR
IMELRBCEHINVEHWATEASTNORTHEASTH
ATEGNANHIFPLLBADIRODMOROSORYBER
LINCLOCKDAVARRUNDISHEDSAVEANLAP

saved reading of 0140: Beaufort form, one alphabet RTKDPNVSXJQMUAZGOBILEYCHWF on both sides, key length 23

2failed at baseline24/24 known lettersloss 1.8%
ECDMRIPFEIMEHNLSSTTRTVDOHW?QINA
RCEOUSEAZEYNONENGEASTNORTHEASTE
DTUDECRSABSOSCIVEFUSSHKRLDRABER
LINCLOCKCLARINRUNGONTAGTOLEMASC

saved reading of 0142: Beaufort form, one alphabet UTVXRSWEPNHFLZDAOQBJICKGYM on both sides, key length 26

3failed at baseline24/24 known lettersloss 1.8%
ECDMRIPFEIMEHNLSSTTRTVDOHW?QBHE
FEULCLATLYEPHUVALEASTNORTHEASTP
OILTYNESTUCOOTEVELHOURKMRTISBER
LINCLOCKTBYINAROMTHEENEIGNORGHF

saved reading of 0120: Beaufort form, one alphabet NDPEAFCIXWRMUHGYZKOBTJVSQL on both sides, key length 26

4failed at baseline24/24 known lettersloss 1.9%
ECDMRIPFEIMEHNLSSTTRTVDOHW?WRYZ
NNIPNMUPTOMEORJZEEASTNORTHEASTR
BYEASILETFIPLSNGESMUCHASTDCEBER
LINCLOCKHASANDWLANDWOHLUCEKSENP

saved reading of 0120: Beaufort form, one alphabet JCRBOQYZPXVWHSMGAUKNFTIELD on both sides, key length 23

0142 L26: K4 6, copies best 15 (rank 13 of 13); 0146 L8: K4 8, copies best 12 (rank 11 of 13); 0125 running key: K4 8, copies best 22 (rank 42 of 51); 0140 L23: K4 12, copies best 18 (rank 7 of 13); 0144 L13: K4 8, copies best 12 (rank 13 of 13); 0144 L16: K4 8, copies best 18 (rank 13 of 13); 0120 L23: K4 12, copies best 12 (rank 6 of 13); 0120 L26: K4 8, copies best 22 (rank 11 of 13). Plants: 0125 plants 20/20; 0140 plants L26 0/6; 0120 plants L23 2/6; 0120 plants L26 0/6

What was searched, as the harness recorded it.

family
rejudging F1.1, F1.2, F1.3's sampled verdicts with the blind judge (A6.1, part 1)
verdicts
0142, 0146, 0125, 0140, 0144, 0120
cells
8
flag level
p < 0.05 / 8; needs 160 copies per cell
judge calls estimated
216
judge texts sent
290
runs
0142
seconds
124
jobs
13
checks
runs done
10
decryption checked
yes
k4 reading reproduced 26
yes
copies scores reproduced 26
yes
0146
seconds
444
jobs
13
checks
runs done
10
decryption checked
yes
k4 reading reproduced 8
yes
copies scores reproduced 8
yes
0125
seconds
333
jobs
71
checks
k4 reading reproduced
yes
copies scores reproduced
yes
0140
seconds
683
jobs
55
checks
runs done
10
decryption checked
yes
k4 reading reproduced 23
yes
copies scores reproduced 23
yes
0144
seconds
687
jobs
26
checks
runs done
10
decryption checked
yes
k4 reading reproduced 13
yes
copies scores reproduced 13
yes
k4 reading reproduced 16
yes
copies scores reproduced 16
yes
0120
seconds
778
jobs
38
checks
k4 reading reproduced 23
yes
k4 reading reproduced 26
yes
by cell
  1. cell
    0142 L26
    k4 judge
    6
    k4 judge reading
    ? NONE ? FUSS ? CLARIN RUNG ON TAG TO ?
    copies judge
    12, 12, 6, 12, 6, 15, 7, 6, 14, 12, 12, 7
    copies best
    15
    k4 above every copy
    no
    k4 rank
    13
    n copies
    12
    none
    0
    k4 reading
    QINARCEOUSEAZEYNONENGEASTNORTHEASTEDTUDECRSABSOSCIVEFUSSHKRLDRABERLINCLOCKCLARINRUNGONTAGTOLEMASC
  2. cell
    0146 L8
    k4 judge
    8
    k4 judge reading
    ? BURGH ? TO FLY ? KINGS ADVER ? AVE ? QUO DEMO GOOF GLA
    copies judge
    12, 6, 12, 6, 12, 12, 8, 12, 8, 8, 8, 12
    copies best
    12
    k4 above every copy
    no
    k4 rank
    11
    n copies
    12
    none
    0
    k4 reading
    ZEMYBMWDBURGHAPTGCWEDEASTNORTHEASTYIDWCKUNDTOFLYPSHAYKINGSADVERBERLINCLOCKAVEFLIVATQUODEMOGOOFGLA
  3. cell
    0125 running key
    k4 judge
    8
    k4 judge reading
    ? CEFEEREDADFIZ ? GWENT ACT TWI ?
    copies judge
    7, 22, 12, 6, 8, 8, 8, 12, 12, 15, 12, 12, 15, 12, 12, 6, 12, 12, 7, 12, 14, 15, 15, 12, 10, 8, 4, 6, 12, 6, 6, 8, 12, 8, 12, 12, 14, 8, 12, 12, 12, 22, 8, 8, 22, 12, 6, 12, 8, 8
    copies best
    22
    k4 above every copy
    no
    k4 rank
    42
    n copies
    50
    none
    0
    k4 reading
    ??????????????????????????????????CEFEEREDADFIZ?GWENTACTTWI??????????????????????????????????????
  4. cell
    0140 L23
    k4 judge
    12
    k4 judge reading
    BOAR I MEL ? ? ? ? HATE ? ? BAD ? ? ? SORY ? ? ? RUN DISHED SAVE AN LAP
    copies judge
    12, 12, 12, 14, 7, 18, 8, 12, 10, 8, 6, 8
    copies best
    18
    k4 above every copy
    no
    k4 rank
    7
    n copies
    12
    none
    0
    k4 reading
    BOARIMELRBCEHINVEHWATEASTNORTHEASTHATEGNANHIFPLLBADIRODMOROSORYBERLINCLOCKDAVARRUNDISHEDSAVEANLAP
  5. cell
    0144 L13
    k4 judge
    8
    k4 judge reading
    DBUGHHPROLEITEDREOFVI ????? LY OWN EN WAS IN EN OH W CIT AFF MY S BUR ????? O BAY GUIOR Y FAKE LY US FUM WO
    copies judge
    8, 8, 12, 12, 12, 8, 8, 12, 8, 12, 12, 8
    copies best
    12
    k4 above every copy
    no
    k4 rank
    13
    n copies
    12
    none
    0
    k4 reading
    DBUGHHPROLEITEDREOFVIEASTNORTHEASTLYOWNENWASINENOHWCITAFFMYSBURBERLINCLOCKOBAYGUIORYFAKELYUSFUMWO
  6. cell
    0144 L16
    k4 judge
    8
    k4 judge reading
    KDOW BOO OF GOL PRE AT IN CER ############# YIRTI DONT TO STEN EETS BE IP HYAVAM ########### Y WAS TILING LD PRE VELOS IN P
    copies judge
    8, 12, 18, 12, 12, 8, 12, 8, 8, 12, 12, 12
    copies best
    18
    k4 above every copy
    no
    k4 rank
    13
    n copies
    12
    none
    0
    k4 reading
    KDOWBOOFGOLPREATINCEREASTNORTHEASTYIRTIDONTTOSTENEETSBEIPHYAVAMBERLINCLOCKYWASTILINGLDPREVELOSINP
  7. cell
    0120 L23
    k4 judge
    12
    k4 judge reading
    ? TOME OR ? BY EASI? LET ? MUCH AS ? HAS AND ? LAND ? LUCK? ?
    copies judge
    6, 5, 8, 12, 3, 12, 12, 8, 4, 12, 8, 12
    copies best
    12
    k4 above every copy
    no
    k4 rank
    6
    n copies
    12
    none
    0
    k4 reading
    WRYZNNIPNMUPTOMEORJZEEASTNORTHEASTRBYEASILETFIPLSNGESMUCHASTDCEBERLINCLOCKHASANDWLANDWOHLUCEKSENP
  8. cell
    0120 L26
    k4 judge
    8
    k4 judge reading
    ? ? ? COOT ? HOUR ? ? BY IN A ? THE ? ?
    copies judge
    8, 8, 12, 22, 6, 6, 12, 8, 8, 8, 8, 8
    copies best
    22
    k4 above every copy
    no
    k4 rank
    11
    n copies
    12
    none
    0
    k4 reading
    QBHEFEULCLATLYEPHUVALEASTNORTHEASTPOILTYNESTUCOOTEVELHOURKMRTISBERLINCLOCKTBYINAROMTHEENEIGNORGHF
plants
  1. group
    0125 plants
    against
    the 50 copies
    plants judge
    85, 72, 82, 72, 66, 72, 45, 82, 85, 85, 55, 62, 55, 62, 62, 72, 72, 52, 62, 80
    found
    20
    of
    20
    plant detail
    yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes, yes
    none
    0
  2. group
    0140 plants L26
    against
    their own 6 fitting shuffles each
    plants judge
    14, 8, 12, 12, 8, 14
    found
    0
    of
    6
    plant detail
    34, 35, 39, 36, 33, 44
    none
    0
  3. group
    0120 plants L23
    against
    K4's 12 copies at 23
    plants judge
    12, 14, 8, 12, 14, 7
    found
    2
    of
    6
    plant detail
    37, 41, 34, 34, 32, 36
    none
    0
  4. group
    0120 plants L26
    against
    K4's 12 copies at 26
    plants judge
    12, 14, 12, 8, 12, 8
    found
    0
    of
    6
    plant detail
    29, 37, 38, 38, 43, 36
    none
    0
k4 above every copy cells
none
chance expected
0.56
stop queue candidates
none
copies
each verdict's own, made by its frozen code and seeds (0120: seed 120; 0125: 125; 0140: 140; 0142: 142; 0144: 144; 0146: 146)
controls
gate 4: the quadgram scores of every copy reading regenerated here (0120, 0140, 0142, 0144, 0146) and 0140/0142's saved controls; the re-submitted K4 readings of 0120, 0140, 0142 face at least their own copies (issue #88)
exhaustive
no

How this experiment sits among the others is on the lineage page; its family's open hypotheses are on the families page.

Rendered from the record on 2026-11-05 17:14 UTC; updated after every experiment.
view on GitHub