Evaluation of activities of daily living using an electronic version of the Longshi Scale in patients with stroke: reliability, consistency, and preference

Background The Longshi Scale is a pictorial assessment tool for evaluating activities of daily living (ADL) in patients with stroke. The paper-based version presents challenges; thus, the WeChat version was created to enhance accessibility. Herein, we aimed to validate the inter-rater and test-retest reliabilities of the WeChat version of the Longshi Scale and explore its potential clinical applications. Methods We recruited 115 patients with stroke in the study. The ADL results of each patient were assessed using both the WeChat and paper-based version of the Longshi Scale; each evaluation was conducted by 28 health professionals and 115 caregivers separately. To explore the test-retest reliability of the WeChat version, 22 patients were randomly selected and re-evaluated by health professionals using the WeChat version. All evaluation criteria were recorded, and all evaluators were surveyed to indicate their preference between the two versions. Results Consistency between WeChat and the paper-based Longshi Scale was high for ADL scores by health professionals (ICC2,1 = 0.803-0.988) and caregivers (ICC2,1 = 0.845-0.983), as well as for degrees of disability (kappa w = 0.870 by professionals; kappa w = 0.800 by caregivers). Bland-Altman analysis showed no significant discrepancies. The WeChat version exhibited good test-retest reliability (kappa w = 0.880). The WeChat version showed similar inter-rater reliability in terms of the ADL score evaluated using the paper-based version (ICC2,1 = 0.781-0.941). The time to complete assessments did not differ significantly, although the WeChat version had a shorter information entry time (P < 0.001, 95% confidence interval: -43.463 to -15.488). Health professionals favored the WeChat version (53.6%), whereas caregivers had no significant preference. Conclusions The WeChat version of the Longshi Scale is reliable and serves as a suitable alternative for health professionals and caregivers to assess ADL levels in patients with stroke. The WeChat version of the Longshi Scale is considered user-friendly by health professionals, although it is not preferred by caregivers. Trial registration This study was approved by the Ethics Committee of the Second People's Hospital of Shenzhen (approval number: 20210812003-FS01) and registered on the Clinical Trial Register Center website: clinicaltrials.gov on January 31, 2022 (registration no.: NCT05214638).