Re-run of the reproducibility package by the third verification run (2026-10-22, UTC times)

Method. The archive source.zip of the package (sha256 dd47de426e02e6634b55f47ec6b22cfc49f526e001e1e15163d3a5828dcec0d0,
the version before this run) was extracted into a new, empty folder (all folders extracted with mode 755). Every
program was run from its folder in the extracted copy with `nice -n 10 python3 -I -B` (python3 = Python 3.13.5;
"venv" below = Python 3.13.5 with numpy 2.5.2, for the programs of the second run), at most four processes at a
time, each with its output written to a separate folder, never over a recorded output. Each output was then
compared with the recorded output(s) named in RERUN_LOG.txt: after removing running times, progress lines and
shell timing lines, every remaining line of the new output must occur in the recorded file.

Runs (time of the end, name, exit code, wall time, folder relative to reproducibility/, command):
  16:58:32Z co_ABC exit=0 28.3s cwd=. cmd=py check_note.py
  16:58:33Z orig_sanity exit=0 0.9s cwd=. cmd=py sanity.py
  16:58:34Z orig_preg_11_5_3 exit=0 1.0s cwd=. cmd=py preg.py 11 5 3
  16:58:34Z orig_preg_11_4_3 exit=0 0.3s cwd=. cmd=py preg.py 11 4 3
  16:58:35Z orig_preg_11_4_4 exit=0 1.2s cwd=. cmd=py preg.py 11 4 4
  16:58:39Z orig_preg_11_4_5 exit=0 3.7s cwd=. cmd=py preg.py 11 4 5
  16:58:39Z orig_preg_7_3_3 exit=0 0.1s cwd=. cmd=py preg.py 7 3 3
  16:58:39Z orig_allV_gen_11_4_3 exit=0 0.4s cwd=. cmd=py allV_gen.py 11 4 3
  16:58:39Z orig_allV_gen_5_3_2 exit=0 0.0s cwd=. cmd=py allV_gen.py 5 3 2
  16:58:40Z orig_allV_gen_7_4_2 exit=0 0.1s cwd=. cmd=py allV_gen.py 7 4 2
  16:59:24Z orig_allV_gen_11_6_2 exit=0 44.7s cwd=. cmd=py allV_gen.py 11 6 2
  16:59:24Z orig_allV_gen_5_2_3 exit=0 0.0s cwd=. cmd=py allV_gen.py 5 2 3
  16:59:24Z orig_allV_gen_7_2_4 exit=0 0.0s cwd=. cmd=py allV_gen.py 7 2 4
  16:59:24Z orig_allV_gen_11_3_4 exit=0 0.1s cwd=. cmd=py allV_gen.py 11 3 4
  16:59:24Z orig_allV_gen_13_2_7 exit=0 0.0s cwd=. cmd=py allV_gen.py 13 2 7
  16:59:25Z orig_allV_gen_11_2_6 exit=0 0.0s cwd=. cmd=py allV_gen.py 11 2 6
  17:00:06Z orig_allV_gen_19_5_4 exit=0 41.7s cwd=. cmd=py allV_gen.py 19 5 4
  17:00:07Z orig_mech_11_4_3 exit=0 0.4s cwd=. cmd=py mech.py 11 4 3
  17:00:07Z orig_mech_7_4_2 exit=0 0.1s cwd=. cmd=py mech.py 7 4 2
  17:00:51Z orig_mech_11_6_2 exit=0 44.5s cwd=. cmd=py mech.py 11 6 2
  17:01:48Z orig_allV exit=0 56.2s cwd=. cmd=py allV.py
  17:04:36Z orig_family exit=0 168.4s cwd=. cmd=py family.py
  17:04:37Z ws_preg_13_4_4 exit=0 1.2s cwd=. cmd=py preg.py 13 4 4
  17:04:57Z ws_preg_19_6_4 exit=0 20.1s cwd=. cmd=py preg.py 19 6 4
  17:05:18Z ws_preg_19_5_5 exit=0 20.3s cwd=. cmd=py preg.py 19 5 5
  17:05:47Z orig_rand_11_4_3_w1 exit=0 29.6s cwd=. cmd=py rand_pairs.py 11 4 3 200 w1 1
  17:05:57Z orig_rand_11_4_3_sparse exit=0 9.2s cwd=. cmd=py rand_pairs.py 11 4 3 200 sparse 1
  17:07:06Z orig_rand_11_4_3_rand exit=0 69.7s cwd=. cmd=py rand_pairs.py 11 4 3 200 rand 1
  17:08:33Z orig_rand_11_4_4_w1 exit=0 87.2s cwd=. cmd=py rand_pairs.py 11 4 4 150 w1 2
  17:09:03Z orig_rand_11_4_4_sparse exit=0 29.9s cwd=. cmd=py rand_pairs.py 11 4 4 150 sparse 2
  17:10:12Z orig_rand_11_4_5_w1 exit=0 68.5s cwd=. cmd=py rand_pairs.py 11 4 5 40 w1 3
  17:01:31Z co_L_17_6_3 exit=0 54.7s cwd=. cmd=py check_note.py L 17 6 3
  17:06:28Z co_L_23_6_4 exit=0 297.0s cwd=. cmd=py check_note.py L 23 6 4
  17:23:36Z co_L_29_6_5 exit=0 1028.7s cwd=. cmd=py check_note.py L 29 6 5
  17:09:07Z orig_allV_gen_17_6_3 exit=0 511.3s cwd=. cmd=py allV_gen.py 17 6 3
  17:09:09Z run1_my_exact_11_5_3 exit=0 1.3s cwd=independent_runs/first_run/mine cmd=py my_exact.py 11 5 3
  17:09:18Z run1_my_exact_17_7_3 exit=0 9.3s cwd=independent_runs/first_run/mine cmd=py my_exact.py 17 7 3
  17:10:01Z run1_my_exact_23_9_3 exit=0 42.7s cwd=independent_runs/first_run/mine cmd=py my_exact.py 23 9 3
  17:12:30Z run1_my_exact_29_11_3 exit=0 149.0s cwd=independent_runs/first_run/mine cmd=py my_exact.py 29 11 3
  17:14:32Z run1_my_graded_11_4_3_all exit=0 121.9s cwd=independent_runs/first_run/mine cmd=py my_graded.py 11 4 3 all
  17:14:32Z run1_brute exit=0 0.8s cwd=independent_runs/first_run/mine cmd=py brute.py
  17:14:33Z run2_exactB_11_5_3 exit=0 0.2s cwd=independent_runs/second_run cmd=venv exactB.py 11 5 3
  17:14:33Z run2_exactB_17_7_3 exit=0 0.2s cwd=independent_runs/second_run cmd=venv exactB.py 17 7 3
  17:14:33Z run2_exactB_23_9_3 exit=0 0.5s cwd=independent_runs/second_run cmd=venv exactB.py 23 9 3
  17:14:35Z run2_exactB_29_11_3 exit=0 1.3s cwd=independent_runs/second_run cmd=venv exactB.py 29 11 3
  17:14:59Z run2_vcheckA_11_4_3_all exit=0 24.0s cwd=independent_runs/second_run cmd=venv vcheckA.py 11 4 3 all
  17:15:32Z run2_vcheckA_17_6_3_nfL exit=0 33.4s cwd=independent_runs/second_run cmd=venv vcheckA.py 17 6 3 nfL
  17:16:06Z run2_vcheckA_17_6_3_nfR exit=0 34.0s cwd=independent_runs/second_run cmd=venv vcheckA.py 17 6 3 nfR
  17:16:09Z run2_vcheckA_19_5_4_nfL exit=0 2.8s cwd=independent_runs/second_run cmd=venv vcheckA.py 19 5 4 nfL
  17:18:30Z run2_vcheckA_23_6_4_nfL exit=0 141.5s cwd=independent_runs/second_run cmd=venv vcheckA.py 23 6 4 nfL
  17:20:52Z run2_vcheckA_13_7_2_nfL exit=0 141.3s cwd=independent_runs/second_run cmd=venv vcheckA.py 13 7 2 nfL
  17:20:53Z run2_hp_check_11_4_3_600 exit=0 0.8s cwd=independent_runs/second_run cmd=venv hp_check.py 11 4 3 600
  17:20:53Z run2_hp_check_19_5_4_100 exit=0 0.5s cwd=independent_runs/second_run cmd=venv hp_check.py 19 5 4 100
  17:20:54Z run2_hp_check_23_6_4_60 exit=0 0.5s cwd=independent_runs/second_run cmd=venv hp_check.py 23 6 4 60
  17:21:56Z run2_vcheckA_29_6_5_nfL exit=0 440.0s cwd=independent_runs/second_run cmd=venv vcheckA.py 29 6 5 nfL
  17:21:04Z run1_lift_5_3_2 exit=0 0.8s cwd=independent_runs/first_run/mine cmd=py lift_test.py 5 3 2 all 0 3 2
  17:21:10Z run1_lift_7_4_2 exit=0 6.5s cwd=independent_runs/first_run/mine cmd=py lift_test.py 7 4 2 all 60 2 3
  17:22:09Z run1_lift_11_4_3 exit=0 58.8s cwd=independent_runs/first_run/mine cmd=py lift_test.py 11 4 3 forms 0 4 11
  17:22:10Z run2_hp_check_17_6_3_300 exit=0 1.1s cwd=independent_runs/second_run cmd=venv hp_check.py 17 6 3 300
  17:22:10Z run2_hp_check_5_3_2_100 exit=0 0.1s cwd=independent_runs/second_run cmd=venv hp_check.py 5 3 2 100
  17:22:10Z run2_hp_check_7_4_2_100 exit=0 0.1s cwd=independent_runs/second_run cmd=venv hp_check.py 7 4 2 100
  17:22:11Z run2_hp_check_11_6_2_100 exit=0 0.2s cwd=independent_runs/second_run cmd=venv hp_check.py 11 6 2 100
  17:22:11Z run2_hp_check_13_7_2_50 exit=0 0.2s cwd=independent_runs/second_run cmd=venv hp_check.py 13 7 2 50
  17:22:15Z run2_erg_11_4_4 exit=0 4.0s cwd=independent_runs/second_run cmd=venv exact_random_general.py 11 4 4 400
  17:22:17Z run2_erg_11_4_5 exit=0 2.1s cwd=independent_runs/second_run cmd=venv exact_random_general.py 11 4 5 200
  17:22:22Z run2_erg_11_5_3 exit=0 4.7s cwd=independent_runs/second_run cmd=venv exact_random_general.py 11 5 3 200
  17:22:24Z run2_erg_13_4_4 exit=0 1.9s cwd=independent_runs/second_run cmd=venv exact_random_general.py 13 4 4 200
  17:22:24Z run2_depth_check exit=0 0.1s cwd=independent_runs/second_run cmd=venv depth_check.py
  17:22:52Z run2_test_bruteforce exit=0 28.1s cwd=independent_runs/second_run cmd=venv test_bruteforce.py
  17:23:07Z run2_exactA_11_4_3 exit=0 14.5s cwd=independent_runs/second_run cmd=venv exactA_random.py 11 4 3 2000
  17:24:07Z run2_exactA_17_6_3 exit=0 60.1s cwd=independent_runs/second_run cmd=venv exactA_random.py 17 6 3 400
  17:24:08Z run2_exactA_7_4_2 exit=0 0.9s cwd=independent_runs/second_run cmd=venv exactA_random.py 7 4 2 400
  17:24:19Z run2_exactA_11_6_2 exit=0 11.1s cwd=independent_runs/second_run cmd=venv exactA_random.py 11 6 2 400
  17:38:24Z orig_targeted exit=0 1654.6s cwd=. cmd=py targeted.py
  17:26:36Z co_C_py39 exit=0 1.1s cwd=. cmd=/usr/bin/python3 (Python 3.9.6) -I -B check_note.py C   (TOTAL failures: 0)

Comparison (one line per output; "0 not in the recorded output" = identical up to running times):
  co_ABC: 57 lines, 0 not in the recorded output
  co_L_17_6_3: 10 lines, 0 not in the recorded output
  co_L_23_6_4: 16 lines, 0 not in the recorded output
  co_L_29_6_5: 24 lines, 0 not in the recorded output
  orig_sanity: 8 lines, 0 not in the recorded output
  orig_allV: 2 lines, 0 not in the recorded output
  orig_family: 6 lines, 0 not in the recorded output
  orig_allV_gen_11_4_3: 1 lines, 0 not in the recorded output
  orig_allV_gen_17_6_3: 1 lines, 0 not in the recorded output
  orig_allV_gen_19_5_4: 1 lines, 0 not in the recorded output
  orig_allV_gen_5_3_2: 2 lines, 0 not in the recorded output
  orig_allV_gen_7_4_2: 2 lines, 0 not in the recorded output
  orig_allV_gen_11_6_2: 2 lines, 0 not in the recorded output
  orig_allV_gen_5_2_3: 1 lines, 0 not in the recorded output
  orig_allV_gen_7_2_4: 1 lines, 0 not in the recorded output
  orig_allV_gen_11_3_4: 1 lines, 0 not in the recorded output
  orig_allV_gen_13_2_7: 1 lines, 0 not in the recorded output
  orig_allV_gen_11_2_6: 1 lines, 0 not in the recorded output
  orig_preg_11_5_3: 5 lines, 0 not in the recorded output
  orig_preg_11_4_3: 5 lines, 0 not in the recorded output
  orig_preg_11_4_4: 5 lines, 0 not in the recorded output
  orig_preg_11_4_5: 5 lines, 0 not in the recorded output
  orig_preg_7_3_3: 5 lines, 0 not in the recorded output
  orig_mech_11_4_3: 2 lines, 0 not in the recorded output
  orig_mech_7_4_2: 2 lines, 0 not in the recorded output
  orig_mech_11_6_2: 2 lines, 0 not in the recorded output
  ws_preg_13_4_4: 5 lines, 0 not in the recorded output
  ws_preg_19_6_4: 5 lines, 0 not in the recorded output
  ws_preg_19_5_5: 5 lines, 0 not in the recorded output
  run1_my_exact_11_5_3: 5 lines, 0 not in the recorded output
  run1_my_exact_17_7_3: 5 lines, 0 not in the recorded output
  run1_my_exact_23_9_3: 5 lines, 0 not in the recorded output
  run1_my_exact_29_11_3: 5 lines, 0 not in the recorded output
  run1_my_graded_11_4_3_all: 1 lines, 0 not in the recorded output
  run1_brute: 45 lines, 0 not in the recorded output
  run2_exactB_11_5_3: 4 lines, 0 not in the recorded output
  run2_exactB_17_7_3: 4 lines, 0 not in the recorded output
  run2_exactB_23_9_3: 4 lines, 0 not in the recorded output
  run2_exactB_29_11_3: 4 lines, 0 not in the recorded output
  run2_vcheckA_11_4_3_all: 7 lines, 0 not in the recorded output
  run2_vcheckA_17_6_3_nfL: 6 lines, 0 not in the recorded output
  run2_vcheckA_17_6_3_nfR: 6 lines, 0 not in the recorded output
  run2_vcheckA_19_5_4_nfL: 6 lines, 0 not in the recorded output
  run2_vcheckA_23_6_4_nfL: 6 lines, 0 not in the recorded output
  run2_vcheckA_29_6_5_nfL: 6 lines, 0 not in the recorded output
  run2_vcheckA_13_7_2_nfL: 7 lines, 0 not in the recorded output
  run2_hp_check_11_4_3_600: 2 lines, 0 not in the recorded output
  run2_hp_check_19_5_4_100: 2 lines, 0 not in the recorded output
  run2_hp_check_23_6_4_60: 2 lines, 0 not in the recorded output
  run1_lift_5_3_2: 1 lines, 0 not in the recorded output
  run1_lift_7_4_2: 1 lines, 0 not in the recorded output
  run1_lift_11_4_3: 1 lines, 0 not in the recorded output
  run2_hp_check_17_6_3_300: 2 lines, 1 not in the recorded output -> expected: weight_bad = 0, cp_in_top = pairs, formula_bad = 0 (c_p = t^{-sigma})
  run2_hp_check_5_3_2_100: 2 lines, 1 not in the recorded output -> expected: weight_bad = 0, cp_in_top = pairs, formula_bad = 0 (c_p = t^{-sigma})
  run2_hp_check_7_4_2_100: 2 lines, 1 not in the recorded output -> expected: weight_bad = 0, cp_in_top = pairs, formula_bad = 0 (c_p = t^{-sigma})
  run2_hp_check_11_6_2_100: 2 lines, 1 not in the recorded output -> expected: weight_bad = 0, cp_in_top = pairs, formula_bad = 0 (c_p = t^{-sigma})
  run2_hp_check_13_7_2_50: 2 lines, 1 not in the recorded output -> expected: weight_bad = 0, cp_in_top = pairs, formula_bad = 0 (c_p = t^{-sigma})
  run2_erg_11_4_4: 1 lines, 0 not in the recorded output
  run2_erg_11_4_5: 1 lines, 0 not in the recorded output
  run2_erg_11_5_3: 9 lines, 0 not in the recorded output
  run2_erg_13_4_4: 1 lines, 0 not in the recorded output
  run2_depth_check: 6 lines, 0 not in the recorded output
  run2_test_bruteforce: 11 lines, 0 not in the recorded output
  run2_exactA_11_4_3: 3 lines, 0 not in the recorded output
  run2_exactA_17_6_3: 3 lines, 0 not in the recorded output
  run2_exactA_7_4_2: 3 lines, 0 not in the recorded output
  run2_exactA_11_6_2: 3 lines, 0 not in the recorded output
  orig_targeted: 2 lines, 1 not in the recorded output -> x reps 25 candidates 11190
  orig_rand_11_4_3_rand.out ['mode rand tested 200 witnesses 0'] in summary file: True
  orig_rand_11_4_3_sparse.out ['mode sparse tested 200 witnesses 0'] in summary file: True
  orig_rand_11_4_3_w1.out ['mode w1 tested 200 witnesses 0'] in summary file: True
  orig_rand_11_4_4_sparse.out ['mode sparse tested 150 witnesses 0'] in summary file: True
  orig_rand_11_4_4_w1.out ['mode w1 tested 150 witnesses 0'] in summary file: True
  orig_rand_11_4_5_w1.out ['mode w1 tested 40 witnesses 0'] in summary file: True

Summary. 68 outputs compared: 62 identical up to running times. In the other 6 every data line occurs in the
recorded output; the extra line is, for the five hp_check.py runs, the fixed explanatory line "expected: ..." that
the program prints after its result (the recorded file run_hp_check.out keeps only the result lines), and for
targeted.py its first line "x reps 25 candidates 11190" (the recorded file is the tail of the output, see
RERUN_LOG.txt, [5]); the last line of targeted.py, "tested 11190 witnesses 0", is the recorded one. The six
rand_pairs.py summary lines occur in runs/rand_pairs_summary.txt. check_note.py, its Part L for the three large
cases and its Part C under Python 3.9.6 end with "TOTAL failures: 0". Not run again: allV_gen.py 23 6 4 (46 min)
and allV_gen.py 29 6 5 (3 h; its first run ended during this verification run and its output was added as
runs/allV_gen_29_6_5.out); both cases are covered by check_note.py L, by the second run's vcheckA.py and by ga.py of
this folder. As in RERUN_LOG.txt [6], the long or memory-heavy programs of the first two runs listed there were not
repeated.
