Metrics for comparative analysis
Set Other
Letter 607 Page 3
Model Other | Model War | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 5 | 25 | 19 |
Levenshtein Distance (Words) | 2 | 22 | 16 |
Word Error Rate (WER in %) | 0.803 | 8.835 | 6.451 |
Char. Error Rate (CER in %) | 0.316 | 1.582 | 1.204 |
Word Accuracy (Wacc in %) | 99.196 | 91.164 | 93.548 |
Hits | 1576 | 1557 | 1558 |
Substitutions | 0 | 18 | 18 |
Deletions | 4 | 5 | 1 |
Insertions | 1 | 2 | 0 |
Total char. in reference | 1580 | 1580 | 1577 |
Total char. in prediction | 1577 | 1577 | 1576 |
Letter 607 Page 17
Model Other | Model War | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 10 | 90 | 84 |
Levenshtein Distance (Words) | 8 | 71 | 62 |
Word Error Rate (WER in %) | 1.941 | 17.233 | 15.012 |
Char. Error Rate (CER in %) | 0.413 | 3.72 | 3.466 |
Word Accuracy (Wacc in %) | 98.058 | 82.766 | 84.987 |
Hits | 2414 | 2334 | 2344 |
Substitutions | 3 | 66 | 63 |
Deletions | 2 | 19 | 16 |
Insertions | 5 | 5 | 5 |
Total char. in reference | 2419 | 2419 | 2423 |
Total char. in prediction | 2422 | 2405 | 2412 |
Letter 722 Page 1
Model Other | Model War | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 9 | 65 | 61 |
Levenshtein Distance (Words) | 6 | 37 | 37 |
Word Error Rate (WER in %) | 3.947 | 24.342 | 24.342 |
Char. Error Rate (CER in %) | 1.032 | 7.454 | 6.995 |
Word Accuracy (Wacc in %) | 96.052 | 75.657 | 75.657 |
Hits | 866 | 811 | 814 |
Substitutions | 5 | 61 | 54 |
Deletions | 1 | 0 | 4 |
Insertions | 3 | 4 | 3 |
Total char. in reference | 872 | 872 | 872 |
Total char. in prediction | 874 | 876 | 871 |
Letter 1170 Page 3
Model Other | Model War | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 11 | 56 | 55 |
Levenshtein Distance (Words) | 7 | 44 | 46 |
Word Error Rate (WER in %) | 2.661 | 16.73 | 17.49 |
Char. Error Rate (CER in %) | 0.684 | 3.484 | 3.422 |
Word Accuracy (Wacc in %) | 97.338 | 83.269 | 82.509 |
Hits | 1597 | 1553 | 1553 |
Substitutions | 7 | 43 | 43 |
Deletions | 3 | 11 | 11 |
Insertions | 1 | 2 | 1 |
Total char. in reference | 1607 | 1607 | 1607 |
Total char. in prediction | 1605 | 1598 | 1597 |
Letter 1358 Page 4
Model Other | Model War | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 7 | 127 | 121 |
Levenshtein Distance (Words) | 6 | 50 | 43 |
Word Error Rate (WER in %) | 8.955 | 74.626 | 64.179 |
Char. Error Rate (CER in %) | 1.369 | 24.853 | 23.679 |
Word Accuracy (Wacc in %) | 91.044 | 25.373 | 35.82 |
Hits | 504 | 386 | 393 |
Substitutions | 4 | 116 | 109 |
Deletions | 3 | 9 | 9 |
Insertions | 0 | 2 | 3 |
Total char. in reference | 511 | 511 | 511 |
Total char. in prediction | 508 | 504 | 505 |
Set War
Letter 678 Page 1
Model War | Model Other | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 11 | 33 | 8 |
Levenshtein Distance (Words) | 9 | 23 | 7 |
Word Error Rate (WER in %) | 5.202 | 13.294 | 4.046 |
Char. Error Rate (CER in %) | 1.038 | 3.116 | 0.755 |
Word Accuracy (Wacc in %) | 94.797 | 86.705 | 95.953 |
Hits | 1048 | 1028 | 1051 |
Substitutions | 10 | 24 | 7 |
Deletions | 1 | 7 | 1 |
Insertions | 0 | 2 | 0 |
Total char. in reference | 1059 | 1059 | 1059 |
Total char. in prediction | 1058 | 1054 | 1058 |
Letter 844 Page 1
Model War | Model Other | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 21 | 40 | 6 |
Levenshtein Distance (Words) | 20 | 32 | 7 |
Word Error Rate (WER in %) | 6.734 | 10.774 | 2.356 |
Char. Error Rate (CER in %) | 1.213 | 2.312 | 0.346 |
Word Accuracy (Wacc in %) | 93.265 | 89.225 | 97.643 |
Hits | 1709 | 1700 | 1724 |
Substitutions | 17 | 25 | 4 |
Deletions | 4 | 5 | 2 |
Insertions | 0 | 10 | 0 |
Total char. in reference | 1730 | 1730 | 1730 |
Total char. in prediction | 1726 | 1735 | 1728 |
Letter 948 Page 1
Model War | Model Other | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 27 | 59 | 9 |
Levenshtein Distance (Words) | 20 | 35 | 8 |
Word Error Rate (WER in %) | 10.928 | 19.125 | 4.371 |
Char. Error Rate (CER in %) | 2.423 | 5.296 | 0.807 |
Word Accuracy (Wacc in %) | 89.071 | 80.874 | 95.628 |
Hits | 1089 | 1059 | 1105 |
Substitutions | 16 | 45 | 7 |
Deletions | 9 | 10 | 2 |
Insertions | 2 | 4 | 0 |
Total char. in reference | 1114 | 1114 | 1114 |
Total char. in prediction | 1107 | 1108 | 1112 |
Letter 1000 Page 3
Model War | Model Other | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 8 | 6 | 9 |
Levenshtein Distance (Words) | 8 | 4 | 8 |
Word Error Rate (WER in %) | 2.807 | 1.403 | 2.807 |
Char. Error Rate (CER in %) | 0.477 | 0.357 | 0.536 |
Word Accuracy (Wacc in %) | 97.192 | 98.596 | 97.192 |
Hits | 1669 | 1671 | 1668 |
Substitutions | 7 | 6 | 9 |
Deletions | 1 | 0 | 0 |
Insertions | 0 | 0 | 0 |
Total char. in reference | 1677 | 1677 | 1677 |
Total char. in prediction | 1676 | 1677 | 1677 |
Letter 1367 Page 1
Model War | Model Other | Model War Retrained | |
---|---|---|---|
Levenshtein Distance (Char.) | 19 | 50 | 13 |
Levenshtein Distance (Words) | 18 | 38 | 13 |
Word Error Rate (WER in %) | 6.545 | 13.818 | 4.727 |
Char. Error Rate (CER in %) | 1.172 | 3.086 | 0.802 |
Word Accuracy (Wacc in %) | 93.454 | 86.181 | 95.272 |
Hits | 1603 | 1574 | 1607 |
Substitutions | 14 | 41 | 11 |
Deletions | 3 | 5 | 2 |
Insertions | 2 | 4 | 0 |
Total char. in reference | 1620 | 1620 | 1620 |
Total char. in prediction | 1619 | 1619 | 1618 |