A feasibility study to assess the validity of administrative data sources and self-reported information of breast cancer survivors

Background: Cancer survivorship has increasingly become the focus of research due to progress in early detection and advancements in the therapeutic approach, but high-quality information sources for outcomes, potential confounders and personal characteristics present a challenge. Few studies have collected breast cancer care data from mixed data sources and validated them, and to the best of our knowledge, none so far have been conducted in Israel, where National Health Insurance Law assures universal health care, delivered through four health care funds with computerized administrative, pharmaceutical and medical databases. This validation study is aimed to assess the accuracy and completeness of information on cancer care and health outcomes using several research tools, before embarking on a full-scale study aimed to evaluate the long-term treatment-related health adverse outcomes in a cohort of breast cancer survivors. Methods: One hundred twenty randomly sampled female patients diagnosed with primary breast cancer in years 2000-2010 in northern Israel, who are members of the "Leumit" healthcare fund, were included. Data sources included "Leumit" medical records, the National Cancer Registry and a self-report questionnaire. The questionnaire was completed by 99 % of the women contacted. The accuracy of the information regarding cancer care was assessed with the reference standard set as one of the research tools, varying per the characteristic being under investigation. For example: health outcomes and medical history were validated against "Leumit" medical records, while construct validity of the self- reported questionnaire served to assess the prevalence of chronic pain. Agreement, predictive values, correlations, and internal consistency were calculated. Logistic regression models were constructed to assess potential predictors of correct responses. Results: The overall level of agreement (Kappa) was almost perfect for demographics and outcomes, above 0.8 for treatments and chronic pain, while only fair to moderate for most of the self- reported medical history. Correct responses of medical history were associated with Jewish ethnicity, recency of breast cancer diagnosis, and family history of cardiovascular disease. The internal consistency of the quality-of-life scale was above 0.9. Conclusion: In the absence of a national registry for cancer care, a mixed methodology for data collection is the most complete source.