Mobile-Assisted Language Learning: A Critical Review of a Duolingo Case Study

Abstract

A critical review of Loewen et al.’s (2019) study of beginners learning Turkish with Duolingo - its strengths in tracking progress and its weaknesses in motivation, sampling and claims about what the app can achieve.

Introduction

This is a critical review of ‘Mobile-assisted language learning: A Duolingo case study’ by Loewen et al. (2019). Due to the enhancement of mobile technology over the last decade, mobile assisted language learning (MALL) platforms have become very popular as people can learn a new language anywhere at any time (Loewen et al., 2019). In the growing industry of MALL technology, there are many applications available for language learners to choose from as integrated technology in language classrooms can help create active learning, which can improve learner engagement, autonomy, and agency (Lomicka&Lord, 2019). These technological improvements can attribute to successful language learners. The authors argue that these platforms claim their applications to be almost as effective or better than face-to-face language classes. The authors’ aim in this study is to investigate Duolingo’s effectiveness in Second Language (L2) learning due to limited past research.

Critical review

Strengths & Weaknesses

All participants in this study are ab initio learners, which is an excellent way to track the learning process and progress of the participants as they all set out from the same starting point (Friedman, 2011). Even though the researchers identify their sample size as being small, they do not factor in that the different language backgrounds of the participants may have an impact on their results. This is because languages have different parameters (Chomsky, 1981) and the participant with the Nepali/ Hindi background may have the upper hand as those languages are closer in parameters to Turkish (Arik, 2019). The data would have been more effective if they had participants from one language background to answer their research questions, there are too many variables in various language backgrounds to draw an appropriate conclusion (Blaxter, 2010). The authors claim that the participants unanimously chose Turkish as their target language, which suggests that the learners would have a degree of motivation as they chose to learn this language. In real life, people learn languages for different reasons (e.g., migration, marriage, study, travel), which is why learners have different levels of interest and motivation to learn a language (Dörnyei, 1998). However, in the methodology the authors point out that this experiment is a part of an obligatory class requirement, and they are fully aware that the participants may not be fully devoted or not have the same attitude as regular Duolingo users. This suggests that the participants may have chosen Turkish randomly as they never come in contact with the language before which would make them ab initio learners. One strength of the study is the measuring of participants’ progress in detail through: journals, which the participants need to record weekly for 12 weeks. This looks into how the learners feel throughout the process, which gives insight into their motivation levels. Duolingo progress test, which is measured through the application by testing the participants’ progression. Turkish 151 test is a university end-of-course level test (measuring listening, speaking, grammar, reading, and writing) administered by a Turkish university teacher. Comparing the Duolingo progress results to the results of a teacher would provide actual insight into how the application measures progress and if that progress report/ feedback is similar. One specific limitation of the methodology is the four phases the participants go through. The actual first phase should have been a level test as this is an academic study. The learners may have said they are ab initio learners, but there is no evidence. Giving the participants an initial level test would provide evidence of their level for an academic study as their starting point (Blaxter, 2010). Phase 1: Participants keep a journal for 12 weeks and have to study Turkish for 34 hours of study on Duolingo. There are no set days or hours each week as the authors want the participants to use their own motivation. However, this is a study, they should be setting goals and a controlled environment for each participant to ensure everyone is participating equally to have reliable results at the end (Blaxter, 2010). This would have given the participants the opportunity to produce the language they learned with each other, which is what happens normally when people start learning a new language(Loewen&Philp, 2011). Phase 2: After 12 weeks the participants complete 2 tests, but two participants left the research, and the rest of the participants did not complete their 34 hours of study. This shows a lack of motivation as there is no need to learn Turkish. Phase 3: Participants who did not complete the task, were given another 12 weeks to complete the 34 hours. This completely changes their initial approach to the research as all participants now have different starting points. Phase 4: remaining participants retake the progress tests. Phases 3 and 4 could have been avoided if Phase 1 was set up properly as pointed out above. Even though the authors point out the limitations of their research (i.e., sample size, choice of language) they justify them by simply stating that this would also happen to other Duolingo users. They then continue to draw conclusions based on their mixed findings and suggest future research. Instead, they should have pointed out all their limitations and suggested a new study of how to prevent the current limitations in their methodology to get appropriate results to draw valid conclusions.

Conclusion

The intentions of the authors are good, and it is an interesting topic to research when the methodology is efficiently put together. Unfortunately, the authors chose their classmates as the participants for the study, they did not structure their weekly goals in a controlled environment to gather data, and they did not provide the participants a platform where they could produce the language learned. The results provided in this study cannot be used as evidence as they are of 7 individuals with different language backgrounds and with various end results. However, the study can be repeated: conducting the study on a larger scale where participants have to come in at university to study using Duolingo individually where participants can meet other participants every 3 weeks over a 12-week period to produce what they have learned, to keep them engaged and motivated. ensuring they all have the same first language, so the results are reliable. having an initial level test, to provide evidence of ab initio learners. (Wordcount: 1047)

References

Arik, E (2019). An Experimental Approach to Basic Word Order in Turkish Intransitives. Psychology of Language and Communication. 20 (1): 73–91. https://doi.org/10.1515/plc-2016-0004 Blaxter, L., Hughes, C., & Tight, M. (2010). How to research (4th ed.). Chomsky, N. (1981). Knowledge of language: Its elements and origins. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 295(1077), 223-234. Dörnyei, Z. (1998). Motivation in second and foreign language learning. Language Teaching, 31(3), 117-135.

← Back to Papers