Aims: Cut-off scores for determining positivity of biomarkers detected by immunohistochemistry are often set arbitrarily and vary between reports. In the present study we evaluate the performance of receiver operating characteristic (ROC) curve analysis in determining clinically important cut-off scores for a novel tumor marker, RHAMM and demonstrate the reproducibility of the selected cut-off scores in 1197-mismatch-repair (MMR) proficient colorectal cancers (CRC).
Methods: Immunohistochemistry for RHAMM was performed using a tissue microarray of 1197 MMR-proficient CRC. Immunoreactivity was scored using a semi-quantitative scoring method by evaluating the percentage of positive tumor cells. ROC curve analysis was performed for T stage, N stage, tumor grade, vascular invasion and survival. The score with the shortest distance from the curve to the point with both maximum sensitivity and specificity, i.e., the point (0.0, 1.0), was selected as the cut-off score leading to the greatest number of tumors correctly classified as having or not having the clinical outcome. In order to determine the reliability of the selected cut-off scores, 100-bootstrapped replications were performed to re-sample the data.
Results: The cut-off score for T stage, N stage, tumor grade and vascular invasion was 100% and that for survival 90%. The most frequently selected cut-off score from the 100 re-samples was also 100% for T stage, N stage, tumor grade, and vascular invasion and 90% for survival.
Conclusions: ROC curve analysis can be used as an alternative method in the selection and validation of cut-off scores for determining clinically relevant threshold for immunohistochemical tumor positivity.
- ROC curve analysis
- colorectal cancer
- scoring system