Assessing the Effectiveness of E-learning via User Profile Analysis: An AHP-based Dynamic Programming Approach

10.6131/MISR.201109_17(1).0003

Hamed Fazlollahtabar；Iraj Mahdavi；Nezam Mahdavi-Amiri

Electronic learning (E-learning) ； Adaptive Learning System ； Virtual Learning Environment (VLE) ； Dynamic Programming ； Analytical Hierarchy Process (AHP)

MIS REVIEW：An International Journal

17卷1期（2011 / 09 / 01）

39 - 61

英文

Electronic learning (E-learning) has been widely adopted as a promising tool by many organizations to offer learning-on-demand opportunities to individual employees (learners) in order to reduce training time and cost. While the success of information system (IS) models has much been investigated by researchers, little work has been conducted to assess the success and/or effectiveness of E-learning systems. The development of information technologies has contributed to the growth of on-line training as an important educational method. The on-line training environment enables learners to undertake customized training at any time and any place. Moreover, information technology allows both the trainers and learners to be decoupled in terms of time, place, and space. Here, we propose an assessment procedure by applying a dynamic programming approach to model the problem of shortest path in the user profile and using AHP (Analytical Hierarchy Process) to turn the qualitative parameters into quantitative values. A dynamic program is used to find the optimal path for the user in the E-learning environment. The validity and effectiveness of the proposed model are illustrated by two examples.

1. Paiva, A. (1995), ‘About user and learner modeling -- an overview', available at http://cbl.leeds.ac.uk/~euroaied/papers/Errico (accessed 25 January 2001).
2. Akkerman, S.,Van den Bossche, P.,Admiraal, W.,Gijselaers, W.,Segers, M.,Simons, R. J.,Kirschner, P.(2007).Reconsidering group cognition: from conceptual confusion to a boundary area between cognitive and socio-cultural perspectives?.Educational Research Review,2,39-63.
3. Alavi, M.,Leidner, D. E.(2001).Research commentary: technology-mediated learning - a call for greater depth and breadth of research.Information Systems Research,12(1),1-10.
4. Alderson, J. C.,Wall, D.(1993).Does washback exist?.Applied Linguistics,14(2),115-129.
5. Bellman, R.(1957).Dynamic Programming.Princeton, NJ:Princeton University Press.
6. Bellman, R.(2003).Dynamic Programming.New York, NY:Dover.
7. Biggs, J.(1996).Enhancing teaching through constructive alignment.Higher Education,32(3),347-364.
8. Carrillo, C. I. P. D.(2004).Catalonia, Spain,University of Girona.
9. Chen, Q.,Norcio, A. F.,Wang, J.(2000).Neural network based stereotyping for user profiles.Neural Computing and Applications,9(4),259-265.
10. Conati, C.,Gertner, A.,Vanlehn, K.(2002).Using Bayesian networks to manage uncertainty in student modeling.User Modeling and User-Adapted Interaction,12(4),371-417.
11. Fazlollahtabar, H.,Mahdavi, I.(2009).User/tutor optimal learning path in e-learning using comprehensive neuro-fuzzy approach.Educational Research Review,4(2),142-155.
12. Fazlollahtabar, H.,Sharma, N. K.(2008).E-Learning versus face-to-face learning: an economic analysis of higher educational systems in Iran.International Journal of Cyber Society and Education,1(1),49-60.
13. Fazlollahtabar, H.,Yousefpoor, N.(2009).Cost optimization in e-learning-based education systems: implementation and learning sequence.E-Learning and Digital Media,6(2),198-205.
14. Frederiksen, N.(1984).The real test bias: influences of testing on teaching and learning.American Psychologist,39(3),193-202.
15. Hambleton, R. K.,Murphy, E.(1992).A psychometric perspective on authentic measurement.Applied Measurement in Education,5(1),1-16.
16. Harker, P. T.,Vargas, L. G.(1987).The theory of ratio scale estimation: Saaty's analytic hierarchy process.Management Science,33(11),1383-1403.
17. Harp, S. A.,Samad, T.,Villano, M.(1995).Modeling student knowledge with self-organizing feature maps.IEEE Transactions on Systems, Man and Cybernetics,25(5),727-737.
18. Herzog, C.(1994).Fuzzy techniques for understanding student solutions in intelligent tutoring systems.Papers for the Seventh Meeting of GI Section 1.1.5/7.0.1, Intelligent Tutoring Systems,Ulm, Germany:
19. Hiltz, S. R.,Turoff, M.(2002).What makes learning networks effective?.Communications of the ACM,45(4),56-59.
20. Ibaraki, T.(1987).Enumerative approaches to combinatorial optimization - part II.Annals of Operations Research,11(3),397-439.
21. Jameson, A.(1996).Numerical uncertainty management in user and student modeling: an overview of systems and issues.User Modeling and User-Adapted Interaction,5(3/4),193-251.
22. Kay, J.(1995).The um toolkit for cooperative user modelling.User Modeling and User-Adapted Interaction,4(3),149-196.
23. Mahdavi, I.,Fazlollahtabar, H.,Heidarzade, A.,Mahdavi-Amiri, N.,Rooshan, Y. I.(2008).A heuristic methodology for multi-criteria evaluation of Web-based e-learning systems based on user satisfaction.Journal of Applied Sciences,8(24),4603-4609.
24. Mahdavi, I.,Fazlollahtabar, H.,Tajdin, A.,Shirazi, B.(2008).Adaptive statistical analysis on higher educational systems.Journal of Applied Sciences,8(17),2998-3004.
25. Mahdavi, I.,Fazlollahtabar, H.,Yousefpoor, N.(2008).An integrated mathematical programming approach and artificial intelligence techniques for optimizing learning elements in e-learning based educational systems.International Journal of Education and Information Technologies,2(1),87-94.
26. Marsten, R. E.,Morin, T. L.(1978).A hybrid approach to discrete mathematical programming.Mathematical Programming,14(1),21-40.
27. Martello, S.,Pisinger, D.,Toth, P.(2000).New trends in exact algorithms for the 0-1 knapsack problem.European Journal of Operational Research,123,325-332.
28. Meade, L. M.,Presley, A.(2002).R&D project selection using the analytic network process.IEEE Transactions on Engineering Management,49(1),59-66.
29. Plateau, G.,Elkihel, M.(1985).A hybrid method for the 0-1 knapsack problem.Methods of Operations Research,49,277-293.
30. Saaty, T. L.(1980).The Analytical Hierarchy Process: Planning, Priority Setting, Resource Allocation.New York, NY:McGraw-Hill.
31. Severson, A.(2004).Vancouver, Canada,Simon Fraser University.
32. Shee, D. Y.,Tzeng, G. H.,Tang, T. I.(2003).AHP, fuzzy measure and fuzzy integral approaches for the appraisal of information service providers in Taiwan.Journal of Global Information Technology Management,6(1),8-30.
33. Specht, M.(1998).Rhineland-Palatinate, Germany,University of Trier.
34. Stathacopoulou, R.,Magoulas, G. D.,Grigoriadou, M.(1999).Neural network-based fuzzy modeling of the student in intelligent tutoring systems.Proceedings of the International Joint Conference on Neural Networks (IJCNN 1999),Washington, DC:
35. Stokking, K.,van der Schaaf, M.,Jaspers, J.,Erkens, G.(2004).Teachers' assessment of students' research skills.British Educational Research Journal,30(1),93-116.
36. Tajdin, A.,Mahdavi, I.,Shirazi, B.,Sahebjamnia, N.,Fazlollahtabar, H.(2008).Designing an assessment method for e-learning environment using real-time simulators.Journal of Applied Sciences,8(19),3491-3496.
37. Toth, P.(1980).Dynamic programming algorithms for the zero-one knapsack problem.Computing,25(1),29-45.
38. Weiss, G.(Ed.)(1999).Multiagent Systems: A Modern Approach to Distributed Modern Approach to Artificial Intelligence.Cambridge, MA:The MIT Press.
39. Yasdi, R.(2000).A literature survey on applications of neural networks for human-computer interaction.Neural Computing and Applications,9(4),245-258.
40. Zhang, D.,Nunamaker, J. K.(2003).Powering e-learning in the new millennium: an overview of e-learning and enabling technology.Information Systems Frontiers,5(2),207-218.
41. Zimmerman, B. J.(2002).Becoming a self-regulated learner: an overview.Theory into Practice,41(2),64-70.