Personalised and flexible language learning. Optimising adaptive and mobile learning in Italian language beginner classes

Abstract

There are a number of changes and challenges affecting language education at a tertiary level. Blended and personalised learning are two of the main challenges. Data-driven technologies and mobile learning offer new tools to address them. While new digital tools have been recently developed, there is a lack of research on their effective implementation in university courses. In this paper we present the results of a study conducted in Italian beginner units at The University of Western Australia in 2017. These units were redesigned to integrate the mobile and adaptive learning resources available through McGraw-Hill Connect, with the aim of providing students with automated, personalised exercises for language reinforcement; offering students a more regular and flexible way for autonomous practice; improving the quality of contact hours. Besides evaluating the implementation of these resources in the units via a survey, we regularly monitored students' learning behaviours and engagement by analysing data collected from Connect. The results of our study show that adaptive and mobile technologies have a very positive impact on students’ learning, but they also raise questions on our capability to embrace the digital challenges that our universities encourage us to take.

PERSONALISED AND FLEXIBLE LANGUAGE LEARNING OPTIMISING ADAPTIVE AND MOBILE LEARNING IN ITALIAN LANGUAGE BEGINNER CLASSES John Kinder Marinella Caruso Federica Verdina Francesco De Toni CONTEXT OF THE PROJECT NMC Horizon Report Higher Education Edition 2016 2017 ADAPTIVE AND MOBILE LEARNING • Language learning: Duolingo, Busuu, Mango Languages, Rosetta Stone, ... • General: e.g. McGraw-Hill Connect, Pearson-Knewton, ... Existing platforms • Adaptive learning • Specific for language education (secondary/tertiary level) • Mobile and desktop Our idea • LMS integration • Modular (grammar, vocabulary, context, style) STARTING OUR PROJECT We discussed our ideas with.. • Tutors and lecturers in language departments • Computational linguists • UWA Innovation Quarter staff and advisors (Start Something workshops 2016) • UWA Centre for Education Futures STARTING OUR PROJECT • Adaptive learning software for language education • Integration with Blackboard (LMS) • Textbook STARTING OUR PROJECT UWA Centre for Education Futures à Futures Observatory Scholarship Italian Studies 1 and Italian Studies 2, 2017 McGraw-Hill Connect à LearnSmart (adaptive learning) & Avanti! (textbook) Effective integration of adaptive learning tools in the language class Aim Identification of best features PROJECT OBJECTIVES Objectives • Optimising student’s learning and engagement through adaptive, short, regular, ubiquitous assignments • Improving the quality of contact hours • Setting guidelines for optimal use of data collected by language e-learning systems IMPLEMENTATION IN THE UNITS LearnSmart • LearnSmart modules for weekly practice ITAL1401 (Sem 1) – 89 students (12 weeks, 50 mins/week) ITAL1401 (Sem 2) – 43 students • Instant feedback and repeated questions ITAL1402 (Sem 2) - 32 students • Metacognitive skills • Desktop and mobile • up to 20% of final mark Learning analytics DATA COLLECTION AND ANALYSIS Focus groups • With the students (end of semester 1) • With tutors (beginning and end of each semester) Student surveys (end of each semester) Teaching staff diaries • Weekly diaries • Staff’s teaching experience (time spent and self-reflection) • Staff’s perception of student’s preparation, engagement and feedback PROJECT RESULTS: • STUDENTS ENGAGEMENT • LANGUAGE SKILLS • DEVICES PROJECT RESULTS: STUDENTS ENGAGEMENT Modules completed ITAL1401 Sem 1 ITAL1401 Sem 2 ITAL1402 Sem 2 89 STUDENTS 43 STUDENTS 32 STUDENTS 26 20 12 10 8 8 7 6 6 5 5 410 000 311 300 322 312 22 42 32 12 3 4 0 1 2 3 4 5 6 7 8 9 10 11 12 PROJECT RESULTS: STUDENTS ENGAGEMENT Mean (hours minutes) Whole Expected semester Per week (per week) (12 weeks) ITAL1401 Semester 1 11h 07m 0h 55m 0h 50m + 11% ITAL1401 Semester 2 14h 00m 1h 10m 1h 16m - 8% ITAL1402 Semester 2 8h 00m 0h 40m 0h 50m - 21% PROJECT RESULTS: STUDENTS ENGAGEMENT Average of minutes spent on LearnSmart 900 800 700 600 500 400 300 200 100 0 Wk 2 Wk 3 Wk 4 Wk 5 Wk 6 Wk 7 Wk 8 Wk 9 Wk 10Wk 11Wk 12Wk 13 Axis Title ITAL1401 Semester 2 ITAL1402 Semster 2 PROJECT RESULTS: STUDENTS ENGAGEMENT If you have completed the LearnSmart modules regularly, how often did you use LearnSmart each week? 18 10 9 9 7 6 6 5 1 2 0 1 1 0 0 > 5 TIMES/WK 4-3 TIMES/WK TWICE/WK ONCE/WK N/A 36 17 ITAL1401 Sem 1 ITAL1401 Sem 2 22 ITAL1402 Sem 2 answers answers answers PROJECT RESULTS: STUDENTS ENGAGEMENT AFTER completing the LearnSmart modules assigned for each week, how often did you redo the same modules as self-study? 14 13 12 9 7 7 6 1 1 0 2 0 2 0 1 ALWAYS MOST OF THE TIME HALF THE TIME SOMETIMES NEVER 36 17 ITAL1401 Sem 1 ITAL1401 Sem 2 22 ITAL1402 Sem 2 answers answers answers PROJECT RESULTS: SKILLS PRACTICE GRAMMAR VOCABULARY EXTREMELY MODERATELY NEITHER USEFUL NOR USELESS USEFUL USEFUL USELESS ITAL1401 39% 50% 42% 39% 19% 8.5% 0% 2.5% Sem 1 ITAL1401 Sem 2 23% 68% 54.5% 32% 18% 0% 4.5% 0% ITAL1402 Sem 2 29.5% 29.5% 47% 65.5% 23.5% 6% 0% 0% PROJECT • it would be nice if the questions could be varied RESULTS: SKILLS PRACTICE •I would like LearnSmart to cover more up more, it was a bit infuriating when the same grammar practice for what we cover in question appeared 2-3 times in a module (if the Unit. answered correctly), i do understand that repetition is important when one makes mistakes but again •I think the grammar element of it'll be nicer to add more variety to the questions. LearnSmart could be strengthened. •For the modules to have a bit more variety, so •In regards to Learn Smart, I felt that it less of the same questions pop up again mostly covered vocabulary and it may have been good to incorporate some •I would like to see that learn smart includes more Learn Smart grammar practice, if than the same questions repeated on a particular possible. chapter or unit •It would be great if the learnsmart pool for • Good for revision. However, it never questions were greater. Its because doing the had us writing sentences which self study, you encounter the same question often. probably would help greatly PROJECTS RESULTS: SKILLS PRACTICE • It would be useful to have links to the ebook at the top of the page so we can go back and revise / read before attempting the learnsmart. As the course jumps forward and back in the book a little, it was not always easy to find in the book (or ebook) when re-doing learnsmart modules • Maybe an option to view an answer or question translated into English after completing the question (getting it right or wrong) would be useful for people struggling or just for someone's reassurance that they completely understood the question/answer PROJECTS RESULTS: SKILLS PRACTICE •I sometimes felt the vocabulary in the assigned Learnsmart modules didn’t necessarily correlate to what we’d been learning in class. •Sometimes the LS modules are on things we haven't learnt yet, or things we learnt a couple of weeks earlier. Maybe that's intended, not sure. •The LearnSmart modules didn't really correspond with what we had been taught PROJECTS RESULTS: DEVICES What devices did you use to access LearnSmart? You can select more than one device. 34 18 16 9 10 6 1 2 2 2 2 3 DESKTOP LAPTOP TABLET SMARTPHONE COMPUTER ITAL1401 Sem 1 ITAL1401 Sem 2 ITAL1402 Sem 2 PROJECTS RESULTS: DEVICES 1 COULD NOT SET UP PROFILE IN CONNECT 0 0 0 COULD NOT ACCESS CONNECT 0 1 2 LS DID NOT WORK ON COMPUTER / LAPTOP 3 1 0 LS DID NOT WORK ON TABLET 2 2 6 LS DID NOT WORK ON SMARTPHONE 2 12 55.5% 2 OTHER 0 4 8 NONE 16 19 0 2 4 6 8 10 12 14 16 18 20 ITAL1402 Sem 2 ITAL1401 Sem 2 ITAL1401 Sem 1 PROJECTS RESULTS: DEVICES • Very easy to use on a smartphone, and convenient, allowing you to practice anywhere if you have a free five minutes • The app did not work on my phone it was just a blank screen when I downloaded it • Also found it difficult to see different sections and complete different tasks on phone, sometimes buttons to answer questions didn't work (couldn't type in some boxes on smartphone so would automatically get incorrect answers when I tried to submit). • LearnSmart would not load on my smartphone and when it did, it would constantly crash or freeze. PROJECTS RESULTS: DEVICES • The interface of LearnSmart app is not great at all. I wish it was better & more user friendly. • whilst attempting to use learnsmart on my phone it was extremely difficult as the whole page was not visible and could not be expanded and/or scrolled. • The LearnSmart app on my phone was extremely small and i was unable to read it • Operating on mobile devices was a little challenging due to the format, but overall not impossible. • The app for the iPhone is set up similar to the website and not in an app format therefore it was difficult to use as the questions were super small and often it would click the wrong answer due to its size Overall, how useful do you think LearnSmart was in your learning experience in the unit? 16 17 12 9 7 5 5 3 1 0 0 0 0 EXTREMELY MODERATELY SLIGHTLY NEITHER USELESS USEFUL USEFUL USEFUL USEFUL NOR USELESS ITAL1401 Sem 1 ITAL1401 Sem 2 ITAL1402 Sem 2 PERSONALISED AND FLEXIBLE LANGUAGE LEARNING OPTIMISING ADAPTIVE AND MOBILE LEARNING IN ITALIAN LANGUAGE BEGINNER CLASSES John Kinder Marinella Caruso Federica Verdina Francesco De Toni PROJECTS RESULTS: STUDENTS ENGAGEMENT If you have NOT completed the LearnSmart modules regularly, please tell us why. 26 7 7 6 3 1 4 2 2 1 3 3 0 0 1 I DID NOT HAVE TIM I FORGOT I HAD TECHNICAL OTHER N/A PROBLEMS ITAL1401 Sem 1 ITAL1401 Sem 2 ITAL1402 Sem 2 PROJECTS RESULTS: SKILLS PRACTICE Please indicate how useful LearnSmart was in improving your grammar skills and your vocabulary. 18 14 7 11 15 14 5 15 3 12 8 1 5 5 7 4 4 1 0 1 ITAL1401 ITAL1401 ITAL1402 ITAL1401 ITAL1401 ITAL1402 ITAL1401 ITAL1401 ITAL1402 ITAL1401 ITAL1401 ITAL1402 SEM 1 SEM 2 SEM 2 SEM 1 SEM 2 SEM 2 SEM 1 SEM 2 SEM 2 SEM 1 SEM 2 SEM 2 EXTREMELY USELFUL MODERATELY USELFUL NEITHER USELFUL NOR USELESS USELESS Grammar Vocabulary
Last updated
The University of Western Australia, Adjunct
The Australian National University, Faculty Member
The University of Western Australia, Faculty Member