A proposal for benchmarking learning objects

Abstract

This article proposes a methodology for benchmarking learning objects. It aims to deal with two problems related to e-learning: the validation of learning using this method and the return on investment of the process of development and use: effectiveness and efficiency. This paper describes a proposal for evaluating learning objects (LOs) through benchmarking, based on the Learning Object Metadata Standard and on an adaptation of the main tools of the BENVIC project. The Benchmarking of Learning Objects (bLO) method aims to contemplate the properties of LOs, their application and stakeholders, and proposes procedures and tools for evaluating LOs. This method does not intend to be a definite or closed system. It defines a working baseline for evaluating LOs, the first step for creating a more complex and more reliable evaluation system that is constantly improving. The paper introduces the guiding principles of the bLO system that provided the guidelines for the development of the tools. This system includes three main tools, two of which were fully developed, and a complement to improve the applicability of the method. It includes a profiling tool based on the LOM, the benchmarking indicator system, and proposes a competence map as a mechanism for continuous improvement. Additionally, a weighting system for efficiency and effectiveness was developed as a complement to the indicators matrix. The bLO was applied in two different contexts. To test the applicability of this method, three modules on a Master Course in Construction were used. The information provided by this test was important to improve the tools, in particular the indicators system. Later, the bLO method was used as an evaluation tool for some of the outcomes of the European Project entitled "E3: Electronically Enhanced Education in Engineering". This project aimed to develop LOs that were exchanged and evaluated among the international partners. Finally, the paper introduces several areas for future work, aiming at improving the system and integrating it with other systems.