Analyzing the organization of collaborative math problem-solving in online chats using statistics and conversation analysis

In this paper we describe how a statistical test on a hypothesis regarding collaborative math problem solving using online chats showed an unexpected result, whose understanding required the use of qualitative methods. The phenomenon behind the result is identified using Conversation Analysis. This paper demonstrates the importance of using qualitative methods to describe the perspective of participants as a way of interpreting statistical results, revising hypotheses and developing alternative coding schemes and procedures. The combined approach of quantitative and qualitative methods is applied on real data coming from Virtual Math Teams research project (Drexel University) and is identifying issues not addressed so far in the analysis of online collaborative group activity.