Researching impact of mobile phones for development: concepts, methods and lessons for practice

The use of mobile phones is an increasingly important part of development efforts particularly in low income countries. Investment in mobiles for development (m-development) is being led by the mobile phone industry together with donors and development partners across a wide range of development sectors. As adoption of mobile phones increases it becomes important to research and understand their impact, and to assess to what extent the expansion of m-development is assisting broader development efforts. This paper provides guidance for conducting research on impact assessment for m-development by reviewing 18 published impact studies, and suggests four key building blocks for good practice in impact assessment. These building blocks encompass: the extent to which the studies address the needs of defined audiences or beneficiaries, the choice of types of impact to assess and units of assessment, the application of suitable conceptual frameworks, and the rigor of the methodology followed. The findings suggest that m-development impact assessment to date falls into three main categories: purely quantitative approaches rooted in information economics, and purely qualitative approaches rooted in social impact assessment. A further mixed method category provides cost effective and timely findings, but with the result of diluting the rigor evident at the methodological poles. Overall, the paper concludes there is a need for more and better guidance for the conduct of such studies, in relation to identifying the rationale and objectives, and linking the choice of concepts and methods with the requirements of key audiences and beneficiaries. The paper identifies m-development impact research as a contested area, and by taking stock of experience thus far, seeks to raise the level of debate concerning the relative merit of alternative methodological and conceptual approaches.