Aim: This paper reports an examination of intra- and inter-observer agreement in midwives' visual interpretation of intrapartum cardiotocographs (CTGs).
Background: The issue of intra- and inter-observer agreement in the interpretation of CTG interpretation has serious implications for the validity of electronic fetal heart rate monitoring and subsequent decisions on intrapartum management. However, no studies were found that assessed intra- and inter-observer agreement in midwives' interpretations of CTG tracings.
Methods: Twenty-eight midwives independently interpreted three intrapartum CTG tracings on two separate occasions using a self-administered Cardiotocograph Interpretation Skills Test. Inter-rater agreement in interpretation was assessed by cross-tabulating the two sets of raw data obtained at time 1 and time 2 and computing Cohen's Kappa (kappa). Intra-rater agreement was assessed by computing kappa for each rater with the two sets of raw data (time 1 and time 2) obtained from each individual. The data were collected in 2000.
Results: Overall intra-rater agreement ranged from 'fair to good' (kappa = 0.48) to 'excellent' (kappa = 0.92). Raters' classifications altered in 18% (n = 5) of cases for the normal tracing, in 29% (n = 8) for the suspicious tracing and in 11% (n = 3) for the pathological tracing. Inter-rater agreement was fair to good, with kappa statistics ranging from 0.65 to 0.74, respectively. Agreement was highest in the classification of decelerations (kappa = 0.79) and lowest in the assessment of baseline variability (kappa = 0.50). Overall inter-rater agreement was highest in the suspicious tracing (kappa = 0.77, excellent) and lowest in the normal tracing (kappa = 0.54, fair to good).
Conclusion: Inter- and intra-observer variability are intrinsic characteristics of the interpretation of intrapartum CTGs. Levels of agreement revealed degrees of variation that expose room for improvement. Efforts are needed to reduce inter- and intra-observer variation in interpretation of intrapartum CTG tracings. In addition, research should focus on the development and evaluation of non-invasive, low observer variability methods of intrapartum assessment of fetal well-being. The subjectivity of CTG interpretation and inconsistencies in interpretation should also be considered in intrapartum management, clinical audit and in medico-legal settings.