A Proposal of a Methodology for Evaluating Learning Objects

Abstract

This article proposes a methodology to handle two problems of e-learning: validation of Learning using this method and the return on investment. The first part of this article defines a framework for e-learning, LOs and refers deeper into the problems concerning this recent technology. The European project BENVIC is analyzed, and an adaptation was made to the main tools to contemplate the LOs properties, uses and stakeholders. The methods and tools for a Benchmarking system for LOs (bLO) are described: a LO description based on the Learning Object Metadata standard; a System of Indicators related to LOs; a weighing system that links the indicators proposed with effectiveness and efficiency. Since there isn't a universal model or a quality standard for LOs, the benchmarking system provides a way to compare LOs with other LOs, regarding different features and uses. This system must also include self-evaluation procedures so that a Continuous Improvement System is implemented. In this way, the system will get closer to meet the needs of the real users and will adapt to the LOs changes. The Continuous Improvement System guarantees that the method will not became obsolete. It will evolve with time and use and will follow the changes of technology, pedagogy and will meet users' needs. The methodology here proposed does not intend to be a definite or closed system. It defines a working baseline for evaluating LOs, the first step for creating a more complex and more reliable evaluation system.