All | Seminoma | Non-seminoma | ||||||||||
Algorithm | Expert 1 | Expert 2 | Expert 3 | Algorithm | Expert 1 | Expert 2 | Expert 3 | Algorithm | Expert 1 | Expert 2 | Expert 3 | |
Algorithm | 1 | 0.38 | 0.26 | 0.41 | 1 | 0.40 | 0.25 | 0.35 | 1 | 0.27 | 0.11 | 0.39 |
Expert 1 | – | 1 | 0.36 | 0.40 | – | 1 | 0.33 | 0.40 | – | 1 | 0.37 | 0.32 |
Expert 2 | – | – | 1 | 0.22 | – | – | 1 | 0.21 | – | – | 1 | 0.08 |
Expert 3 | – | – | – | 1 | – | – | – | 1 | – | – | – | 1 |
Average kappa between algorithm and expert | 0.35 | 0.33 | 0.25 | |||||||||
Average kappa between experts | 0.32 | 0.31 | 0.25 |