Intended for healthcare professionals

CCBYNC Open access
Research

An independent and external validation of QRISK2 cardiovascular disease risk score: a prospective open cohort study

BMJ 2010; 340 doi: https://doi.org/10.1136/bmj.c2442 (Published 13 May 2010) Cite this as: BMJ 2010;340:c2442
  1. Gary S Collins, senior medical statistician1,
  2. Douglas G Altman, director, professor of statistics in medicine1
  1. 1Centre for Statistics in Medicine, Wolfson College Annexe, University of Oxford, Oxford OX2 6UD
  1. Correspondence to: G Collins gary.collins{at}csm.ox.ac.uk
  • Accepted 23 April 2010

Abstract

Objective To evaluate the performance of the QRISK2 score for predicting 10-year cardiovascular disease in an independent UK cohort of patients from general practice records and to compare it with the NICE version of the Framingham equation and QRISK1.

Design Prospective cohort study to validate a cardiovascular risk score.

Setting 365 practices from United Kingdom contributing to The Health Improvement Network (THIN) database.

Participants 1.58 million patients registered with a general practice between 1 January 1993 and 20 June 2008, aged 35-74 years (9.4 million person years) with 71 465 cardiovascular events.

Main outcome measures First diagnosis of cardiovascular disease (myocardial infarction, angina, coronary heart disease, stroke, and transient ischaemic stroke) recorded in general practice records.

Results QRISK2 offered improved prediction of a patient’s 10-year risk of cardiovascular disease over the NICE version of the Framingham equation. Discrimination and calibration statistics were better with QRISK2. QRISK2 explained 33% of the variation in men and 40% for women, compared with 29% and 34% respectively for the NICE Framingham and 32% and 38% respectively for QRISK1. The incidence rate of cardiovascular events (per 1000 person years) among men in the high risk group was 27.8 (95% CI 27.4 to 28.2) with QRISK2, 21.9 (21.6 to 22.2) with NICE Framingham, and 24.8 (22.8 to 26.9) with QRISK1. Similarly, the incidence rate of cardiovascular events (per 1000 person years) among women in the high risk group was 24.3 (23.8 to 24.9) with QRISK2, 20.6 (20.1 to 21.0) with NICE Framingham, and 21.8 (18.9 to 24.6) with QRISK1.

Conclusions QRISK2 is more accurate in identifying a high risk population for cardiovascular disease in the United Kingdom than the NICE version of the Framingham equation. Differences in performance between QRISK2 and QRISK1 were marginal.

Introduction

Cardiovascular disease is an important health concern globally, with just under a third of all deaths attributed to cardiovascular disease in 2004 (www.who.int, fact sheet No 317). In the United Kingdom, there are almost 200 000 deaths each year relating to diseases of the heart and circulatory system, with more than one in three deaths associated with cardiovascular disease (www.heartstats.org). General practitioners need an accurate and reliable tool to help them identify patients at high risk of having a cardiovascular event. Numerous multivariable risk scores have been developed to estimate a patient’s 10 year risk of cardiovascular disease based on certain key known risk factors,1 2 including the Framingham risk score3 and the Reynolds risk score,4 both developed using patient data from US, the SCORE system using patients from multiple European countries,5 and ASSIGN using patients from Scotland.6 In the United Kingdom, until recently the National Institute for Health and Clinical Excellence (NICE) recommended use of the long established Framingham equation to inform a patient treatment plan about cardiovascular risk.3 NICE have now ceased recommending any single risk score equation, leaving healthcare professionals to choose the tool they consider to be most appropriate.7

The QRISK1 risk score, derived by the QRESEARCH organisation of the University of Nottingham, is a model to predict the 10 year risk of developing cardiovascular disease. It was developed8 and validated9 10 on large general practice databases in the United Kingdom using data from three million patients with 17.5 million person years of observation. QRISK1 includes traditional risk factors such as age, sex, systolic blood pressure, smoking status, and total serum cholesterol:high density lipoprotein ratio that are included in the long established Framingham equations, but it also includes body mass index, family history of cardiovascular disease, social deprivation (Townsend score), and use of antihypertensive treatment. Performance data comparing QRISK1 with the Framingham equation indicated that QRISK1 is a more accurate tool to predict the development of cardiovascular disease in the United Kingdom.9 11

QRISK2, the successor to QRISK1, is a new multivariable risk score that contains all the risk factors that are in QRISK1 but also includes self assigned ethnicity and conditions associated with cardiovascular risk (including diagnosed type 2 diabetes, treated hypertension, rheumatoid arthritis, renal disease, and atrial fibrillation).12 QRISK2 also contains interactions between age and Townsend score, body mass index, systolic blood pressure, family history, smoking status, treated hypertension, diagnosis of type 2 diabetes, and atrial fibrillation (see box for variables included in QRISK1, QRISK2 and NICE Framingham). All continuous risk factors were carefully handled and kept continuous throughout the model building process, fractional polynomials were used to model nonlinear risk relations where appropriate.13 Technical details of the actual QRISK2 model can be found on the QRESEARCH website (www.qresearch.org).

Summary of risk factors in QRISK1, QRISK2, and Framingham equation

QRISK1
  • Age (continuous)

  • Ratio of total serum cholesterol:high density lipoprotein (continuous)

  • Systolic blood pressure (continuous)

  • Smoking status (current smoker/non-smoker (including former smoker))

  • Body mass index (continuous)

  • Family history of coronary heart disease in first degree relative under 60 years (yes/no)

  • Townsend deprivation score (output area level 2001 census data evaluated as continuous variable)

  • Receiving treatment for blood pressure at baseline (at least one current prescription of at least one antihypertensive agent) (yes/no)

  • Systolic blood pressure × Receiving treatment for blood pressure at baseline

QRISK2
  • Age (continuous)

  • Ratio of total serum cholesterol:high density lipoprotein (continuous)

  • Systolic blood pressure (continuous)

  • Smoking status (current smoker/non-smoker (including former smoker))

  • Body mass index (continuous)

  • Family history of coronary heart disease in first degree relative under 60 years (yes/no)

  • Townsend deprivation score (output area level 2001 census data evaluated as continuous variable)

  • Treated hypertension (diagnosis of hypertension and at least one current prescription of at least one antihypertensive agent) (yes/no)

  • Self assigned ethnicity (white (or not recorded)/Indian/Pakistani/Bangladeshi/other Asian/black African/black Caribbean/other (including mixed))

  • Type 2 diabetes (yes/no)

  • Rheumatoid arthritis (yes/no)

  • Atrial fibrillation (yes/no)

  • Renal disease (yes/no)

  • Age × body mass index

  • Age × Townsend score

  • Age × systolic blood pressure

  • Age × family history of cardiovascular disease

  • Age × smoking current

  • Age × treated hypertension

  • Age × type 2 diabetes

  • Age × atrial fibrillation

Framingham equation (version recommended by NICE)
  • Age (continuous)

  • Ratio of total serum cholesterol/high density lipoprotein (continuous)

  • Systolic blood pressure (continuous)

  • Smoking status (current smoker (or quit within last year)/non-smoker)

  • Sex (male/female)

  • Left ventricular hypertrophy (yes/no)

  • Type 2 diabetes (yes/no)

  • Age × type 2 diabetes

  • Left ventricular hypertrophy × age

  • Age × sex

After the development of a new multivariable risk score, it needs to be subjected to external validation.14 15 The performance of a risk score is typically overestimated in the original data used to develop the score.14 External validation is a crucial step to provide sufficient evidence about the performance of the risk score on a cohort not used in the score’s development.2 14 15 16 It is disappointing, however, that most risk scores that are published fail to undergo this extra step. Studies that develop and validate risk scores are far too often of low quality, poorly designed, use inappropriate statistical techniques, and are based on small selective cohorts with insufficient numbers of events.14 15 17 18 19 Furthermore, it is likely that many of the risk scores published each year are opportunistically produced to maximise the output from a clinical study for which developing a risk score was not declared a priori before collecting the data.20 Guiding efficient clinical decision making requires that the assessment of risk be accurate, yet many risk scores in use have not adequately shown this essential quality. Low quality risk scores may be used clinically to stratify patients into risk groups or as inclusion or exclusion criteria for randomised controlled trials.

This article describes the results from an independent and external validation of QRISK2 and compares the performance of QRISK2 against QRISK18 and an adjusted version of the Framingham equation3 previously recommended by NICE.21

Methods

Study population

Study participants were patients registered between 1 January 1993 and 20 June 2008 and recorded on the THIN database (www.thin-uk.com). Patients were excluded if they had a prior diagnosis of cardiovascular disease, had invalid dates or invalid recorded risk factor values out of plausible range, were under the age of 35 years, were aged 74 years or over, had missing Townsend scores (social deprivation), or were prescribed statins at baseline.

Cardiovascular disease outcomes

The primary outcome measure was the first diagnosis of cardiovascular disease (myocardial infarction, angina, coronary heart disease, stroke, and transient ischaemic stroke) recorded on the general practice clinical computer system.

Statistical analysis

Ten-year estimated cardiovascular disease risk for every patient in the THIN cohort was calculated using QRISK2. Observed 10-year cardiovascular disease risks were obtained using the method of Kaplan-Meier. Multiple imputation was used to replace missing values for body mass index, systolic blood pressure, total serum cholesterol:high density lipoprotein ratio, and smoking status. Multiple imputation is a powerful technique that offers substantial improvements over the biased and flawed value replacement approaches based on complete cases or cases matched for age and sex.22 23 It involves creating multiple copies of the data and imputing the missing values with sensible values randomly selected from their predicted distribution. We used the MICE (Multivariate Imputation by Chained Equations) library in R software to create 20 imputed datasets and then combined the results from analyses on each of the imputed datasets to produce estimates and confidence intervals that incorporate the uncertainty of imputed values.

Predictive performance of QRISK2 for the THIN cohort was assessed by examining measures of calibration and discrimination. Calibration refers to how closely the predicted 10 year risk of cardiovascular disease agrees with the observed 10 year risk. This was assessed for each tenth of predicted risk, ensuring 10 equally sized groups, and for each 5 year age band by calculating the ratio of predicted to observed risk of cardiovascular disease separately for men and for women. Calibration of the risk score predictions was assessed by plotting observed proportions versus predicted probabilities. The Brier score for censored survival data was also calculated,24 which is a measure of accuracy and is the average squared deviation between predicted and observed risk; a lower score represents higher accuracy.

Discrimination is the ability of the risk score to differentiate between patients who experience a cardiovascular event during the study and those who do not. This measure is quantified by calculating the area under the receiver operating characteristics curve (AUROC) statistic; a value of 0.5 represents chance, and 1 represents perfect discrimination. We also calculated the D statistic25 and R2 statistic26 (derived from the D statistic), which are measures of discrimination and explained variation respectively and are tailored towards censored survival data. Higher values of D indicate greater discrimination, where an increase of 0.1 over other risk scores is a good indicator of improved prognostic separation. Scaled rectangular diagrams are presented to illustrate the discrimination performance of QRISK2 and NICE Framingham.27

Although predicted risk varies across a continuum, clinical decisions require creation of risk groups. An important aspect, therefore, when considering adopting a new risk prediction rule is the classification of patients into high and low risk and the number of patients who would be reclassified to a different risk category when compared with the standard means of risk prediction28 (here the NICE Framingham equation). Patients were identified as high risk if their 10 year predicted cardiovascular disease risk was ≥20%, as per the guidelines set out by NICE.21

We compared the performance of QRISK2 with its predecessor QRISK18 and with a modified version of the Framingham equation3 recommended by NICE. There is an increased risk of developing cardiovascular disease in people with a family history of premature disease, and risk varies between ethnic groups in the United Kingdom. Until recently, the approach recommended by NICE was to apply adjustment factors to the Framingham equation for ethnicity and family history, which are not captured in the Framingham equation. The Framingham score is multiplied by 1.4 for South Asian men (no adjustment for South Asian women) and by 1.5 for people with a history of coronary heart disease in a first degree relative. For South Asian men with a family history of coronary heart disease in a first relative, both adjustments are applied. To date there has been no detailed published scientific evaluation and validation for the choice of adjustment factor.

All statistical analyses were carried out in R (version 2.9.1).29

Results

The THIN database system included 3 587 306 eligible patients registered at 382 practices in the United Kingdom. After sequentially excluding, as per the exclusion criteria, 625 454 patients who left the general practice before 1 January 1993, 1 107 612 aged <35 years or ≥74 years, 161 746 with missing Townsend scores, 86 693 with a prior diagnosis of cardiovascular disease, and 23 019 with prior statin use, the analysed cohort consisted of 1 583 106 patients registered between 1 January 1993 and 20 June 2008 at 365 general practices. The median follow-up was 6.2 years, and 241 859 (15.28%) patients were followed for at least 10 years. The 10 year observed risk of a cardiovascular event in men aged 35-74 years was 9.00% (95% confidence interval 8.90% to 9.10%) and in women was 5.89% (5.81% to 5.96%). Table 1 details the characteristics of eligible patients.

Table 1

 Characteristics of patients from THIN database who were included in study. Values are numbers (percentages) unless stated otherwise

View this table:

Complete data for all risk factors (ratio of total serum cholesterol to high density lipoprotein cholesterol, systolic blood pressure, body mass index, and smoking status) considered were available for 18.4% of women (n=146 651) and 16.0% of men (n=125 978). Most patients (n=1 066 926 (67.4%)) had none or only one missing risk factor. There were markedly high levels of missing data for the total serum cholesterol:high density lipoprotein ratio (74.7% for women and 74.6% for men). For other risk factors, the levels of missing data were, for body mass index, 19.4% for women, 28.5% for men; for systolic blood pressure, 7.4% for women, 16.5% for men; and for smoking status, 20.1% for women, 29.2% for men.

Table 2 shows the incidence rates (per 1000 person years) for cardiovascular disease by age, sex, region of UK, ethnicity, and deprivation index. In total there were 71 465 incident cases of cardiovascular disease during the study period from 9.4 million person years of observation. The age adjusted incidence rate (per 1000 person years) for cardiovascular disease was highest in Scottish women and men (7.97 and 12.04) and lowest in English women and men (5.75 and 9.89).

Table 2

 Crude and age adjusted incidence rates (per 1000 person years) for cardiovascular disease by sex, age, country, ethnicity, and social deprivation

View this table:

The incidence of cardiovascular disease varied widely between different ethnic groups. The age standardised rates (per 1000 person years) for the white reference group were 5.89 for women and 9.20 for men. The highest rates were among the South Asian groups—for example, in Pakistani women the rate was 13.22 (per 1000 person years) and in Pakistani men it was 19.55.

Discrimination and calibration

For an accurate risk score the predicted and observed risks will agree. Fig 1 shows calibration plots for the three risk scores. Both QRISK2 and its predecessor, QRISK1, show much better agreement between observed risk and predicted risk grouped by tenth of risk compared with the NICE adjusted Framingham equation.

Figure1

Fig 1 Plot of observed versus predicted risks of cardiovascular disease for QRISK2, QRISK1, and the NICE adjusted Framingham equation.

Table 3 presents discrimination and calibration performance data for QRISK2, QRISK1, and the NICE adjusted Framingham equation. The R2 statistic (percentage of explained variation) is approximately 5% higher for QRISK2 in both men and women compared with the NICE adjusted Framingham equation. The difference in R2 between QRISK2 and QRISK1 is less pronounced, with QRISK2 explaining around only 1% more of the variation in outcome in both men and women. The D discrimination statistic, where a higher score represents better discrimination, is higher for QRISK2 in both men and women compared with the NICE adjusted Framingham equation. As with the R2 statistic, the difference in the D statistics between QRISK2 and QRISK1 is small. The Brier score (adjusted for censoring), a measure of prediction accuracy, was lower for QRISK2 in both men and women compared with the NICE adjusted Framingham equation. There was no difference between QRISK2 and QRISK1 in Brier score (0.076).

Table 3

 Discrimination and model performance statistics for QRISK2, QRISK1, and NICE Framingham (version of the Framingham equation recommended by NICE) in estimating 10-year risk of a cardiovascular event in the THIN cohort

View this table:

Risk classification

Using a 20% threshold for high risk of having a cardiovascular event, we calculated how many patients would be reclassified from low risk to high risk (and vice versa) using QRISK2 compared with the NICE adjusted version of Framingham.

In total, 90 823 male patients (11.6%) would be reclassified, with 1.8% (11 231) upgraded from low risk with NICE Framingham to high risk with QRISK2 (table 4). The observed risk in these patients was 20.02% (95% confidence interval 16.98% to 23.06%). The average predicted risk with the NICE Framingham equation was 14.73% whereas it was 24.08% with QRISK2. Nearly half the patients assessed as high risk with NICE Framingham (79 592 (45%)) would be downgraded to low risk with QRISK2. The observed risk in these patients was 14.00% (12.28% to 15.72%), compared with a mean predicted risk of 25.14% with NICE Framingham and 14.98% with QRISK2.

Table 4

 Comparison of QRISK2 and NICE Framingham (version of the Framingham equation recommended by NICE) in classification of men in the THIN cohort into low or high 10-year risk of cardiovascular events and observed and predicted risk

View this table:

Similarly, 41 126 female patients (5.2%) would be reclassified, with 15 748 upgraded from low risk with NICE Framingham to high risk with QRISK2 (table 5). The mean observed risk in these patients was 20.07% (18.84% to 21.30%). The average predicted risk with the NICE Framingham equation was 15.19% and with QRISK2 was 23.70%. Likewise, 25 478 patients would be downgraded from high risk with NICE Framingham to low risk with QRISK2, with a mean observed risk of 13.36% (10.72% to 16.00%). The corresponding mean predicted risk was 24.24% with NICE Framingham and 15.32% with QRISK2.

Table 5

 Comparison of QRISK2 and NICE Framingham (version of the Framingham equation recommended by NICE) in classification of women in the THIN cohort into low or high 10-year risk of cardiovascular events and observed and predicted risk

View this table:

Thus for both men and women, the mean predicted risks in patients reclassified from high to low risk (and vice versa) with QRISK2 were more accurate compared with the mean observed risk than mean predicted risks with NICE Framingham (see online appendix for low, intermediate, and high risk classification). Those patients who were reclassified as high risk with QRISK2 from low risk with NICE Framingham tended to be older, have been treated for hypertension, have a family history of coronary heart disease, and have a diagnosis of type 2 diabetes, rheumatoid arthritis, or atrial fibrillation.

The proportion of men and women classified as high risk by QRISK2 and NICE Framingham who had a subsequent cardiovascular event are displayed in fig 2, a scaled rectangular diagram. At current recommended treatment thresholds of 20%, the figure shows the modest discrimination performance of both QRISK2 and the NICE Framingham model. With QRISK2, 14% of the male cohort would be identified as being at high risk and would capture 40% of the cardiovascular events; NICE Framingham would identify 22% of the male cohort and 54% of the cardiovascular events. Similarly, for women, QRISK2 would identify 6% of the cohort as being at high risk and 26% of the cardiovascular events, whereas NICE Framingham would identify 7% of the cohort as high risk and 26% of all cardiovascular events.

Figure2

Fig 2 Proportion of men and women classified as high 10-year risk of cardiovascular events (≥20%) by QRISK2 and the NICE version of the Framingham equation who also had a subsequent cardiovascular event

Incidence of cardiovascular events in high risk groups

Using the 20% threshold to identify high risk patients, QRISK2 identified a group of patients at a higher risk of cardiovascular events than those identified with NICE Framingham. The incidence rate of cardiovascular events among men designated high risk with QRISK2 was 27.8 per 1000 person years (95% confidence interval 27.4 to 28.2), whereas it was 21.9 (21.6 to 22.2) with NICE Framingham and 24.8 (22.8 to 26.9) with QRISK1. For women, the incidence rate of cardiovascular events in those designated high risk was 24.3 (23.8 to 24.9) with QRISK2, 20.6 (20.1 to 21.0) with NICE Framingham, and 21.8 (18.9 to 24.6) with QRISK1. Table 6 shows regional variations in the incidence of cardiovascular events in high risk groups.

Table 6

 Incidence rates of cardiovascular disease (per 1000 person years) in high risk groups* identified by QRISK2 and NICE Framingham (version of the Framingham equation recommended by NICE) across regions of the United Kingdom

View this table:

Discussion

Principal findings

We independently evaluated the performance of the QRISK2 risk score, in comparison with the risk prediction approach (NICE Framingham) that was until recently recommended by the National Institute for Health and Clinical Excellence in the United Kingdom, for predicting 10-year cardiovascular disease in an independent UK cohort of patients from general practice. In this large cohort of 1.6 million patients, the NICE Framingham equation had inferior performance compared with either QRISK2 or its predecessor, QRISK1. The NICE Framingham risk score over-predicted 10-year risk of cardiovascular disease, compared with the more accurate QRISK2 and QRISK1 scores. The difference in performance between QRISK2 and QRISK1 was slight, with QRISK2 marginally outperforming QRISK1. QRISK2 includes five extra risk factors (self assigned ethnicity, type 2 diabetes, rheumatoid arthritis, atrial fibrillation, and chronic renal disease) as well as eight interaction terms. These additional risk factors do not require any considerable effort to collect; ethnicity would be recorded as white if this item were missing or not recorded. Absence of a recorded diagnosis of type 2 diabetes, rheumatoid arthritis, atrial fibrillation, or chronic renal disease is assumed to indicate that the person did not have that factor.

The development cohort (1.5 million patients), internal validation cohort (0.75 million patients), and this external validation cohort (1.6 million patients) included in total nearly 3.9 million patients (about 14% of the UK population aged between 34 and 74 years) with a total of 21 million person years of observation and 211 580 recorded cardiovascular events. This constitutes one of the largest groups of patients used to develop and externally validate a risk score before its recommendation and implementation in clinical practice, and, given the source and combined size of all cohorts, it is likely to be a fair representation of the population for which the equations are to be used.

The superior performance of the QRISK risk scores is not surprising as both QRISK risk scores were developed (and internally and externally validated) on large cohorts of general practice patients in the United Kingdom, the population for which the risk predictions were targeted and designed. This includes accounting for social deprivation, family history of coronary heart disease, and ethnicity, all known to increase the risk of developing cardiovascular disease. The Framingham score, by contrast, was developed on a comparatively small (n=5573), homogeneous white, though treatment-naive, sample from a single town in the US between 1968 and 1975. We evaluated the Framingham risk score with the NICE designated adjustment factors for family history and, for men, being of South Asian origin.

Arguably, QRISK2 would be more aptly compared with a Framingham equation recalibrated for the UK population, but we compared it with the Framingham risk score recommended by NICE, which is without reference to recalibration. Furthermore, the NICE Framingham is a single equation with a sex coefficient, whereas the QRISK approach has separate equations for men and women. Separate equations permit risk factors to be weighted differently for men and women.

Although some have welcomed the introduction of the QRISK equations30 31 and the debate about improving risk prediction, others have cautioned against their use for two main reasons; (a) the cohort used to develop both QRISK equations included patients who were not treatment naive, unlike the Framingham cohort,32 and (b) there are large amounts of missing cholesterol data.33 With regard to the cohorts including patients who may have started additional treatments, it is now neither practically nor ethically possible to obtain large treatment-naive cohorts. Furthermore, although natural history is important, it is not clear that prognosis is best assessed from an untreated population.

Risk scores will inevitably become outdated with improvements in clinical outcomes and data recording and changes in population demographics. Thus, ensuring a risk score retains its usefulness to reflect current conditions is crucial.34 QRISK2 will undergo annual updates to account for changes in population characteristics and improvements in data quality, with its most recent update having been released on 1 April 2010 (see www.qrisk.org for details of this). This entails re-fitting QRISK2 to the latest version of the QRESEARCH database to obtain updated regression coefficients.

Strengths and weaknesses

All the cohorts used in the development and validation of QRISK1 and QRISK2 had high levels of missing data for the total serum cholesterol:high density lipoprotein ratio, so it can be assumed to be a population feature. QRISK1 and QRISK2 were developed using established methods of multiple imputation for missing data to address this problem. Our external validation study also used multiple imputation, with 20 imputed datasets, to deal with the missing data. We note that problems of missing data in developing and validating risk scores are rarely considered when validating risk scores.35 36 37 38 Omitting patients with missing data in developing the risk score and conducting a complete-case analysis would introduce bias and produce a poorly performing risk score. Even in validation, discarding missing observations will result in performance data that is biased, and so that practice should be avoided.37 38

Conclusions

In this study, we have provided an independent and external validation of the QRISK2 risk score on a large cohort of patients in the United Kingdom. We have assessed the performance of QRISK2 against the NICE version of the Framingham equation and have provided evidence to support the use of QRISK2 in favour of the NICE Framingham equation.

What is already known on this topic

  • Cardiovascular risk prediction in the United Kingdom has until recently been based on a NICE adjusted version of the US Framingham model that has been shown to over-predict risk

  • QRISK2 was developed using a large cohort of UK patients and published in 2008

  • Risk prediction models need to be independently and externally validated to evaluate performance objectively

What this study adds

  • Independent evaluation of QRISK2 showed an improvement in performance over NICE Framingham in a large external cohort of UK patients

  • QRISK2 identified a group of high risk patients who will go on to experience more cardiovascular events over the next 10 years than a similar high risk group identified by NICE Framingham

Notes

Cite this as: BMJ 2010;340:c2442

Footnotes

  • Contributors: GSC conducted the analysis and prepared the first draft, which was revised according to comments and suggestions from DGA. GSC is guarantor for the paper.

  • Funding: This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

  • Competing interests: All authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare that GSC and DGA have no non-financial interests that may be relevant to the submitted work.

  • Ethical approval: Trent multicentre research ethics committee.

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.

References

View Abstract