Fahrenbach, Florian. 2022. A design science approach to developing and evaluating items for the assessment of transversal professional competences. Education + Training.

RIS

@ARTICLE{Fahrenbach2022,
title = {A design science approach to developing and evaluating items for the assessment of transversal professional competences},
author = {Florian Fahrenbach},
year = {2022},
doi = {10.1108/ET-03-2020-0056},
url = {https://www.emerald.com/insight/content/doi/10.1108/ET-03-2020-0056/full/html},
language = {EN},
journal = {Education + Training},
abstract = {Purpose Relying on a design science paradigm, the purpose of this paper is to describe the development and evaluation of items for an ICT artefact that supports the assessment of transversal professional competences within the validation of prior learning (VPL). To do so, the authors build a conceptual bridge between the Occupational Information Network (O*NET) and the European Qualifications Framework (EQF). Design/methodology/approach Design science research paradigm, in particular the participatory development of candidate items and their evaluation in a multi-stakeholder approach. Findings The authors find that a self-assessment of professional competences should be comprised of 160 items in order to cover the breadth and depth of the O*NET in the hierarchical taxonomy. Such quantity of items sufficiently builds a conceptual bridge between the O*NET and the; EQF. Practical implications When designing procedures for the VPL, it is imperative to bear in mind the purpose of the validation procedure, in order to determine relevant stakeholders and their needs in advance as well as the; required language proficiency of the assessment instrument. Social implications The innovative value of this approach lies in the combination of an underlying hierarchical taxonomy with assessment items that are developed based on the qualification standards of different Austrian professions. Together with specific verbs that were adapted for each particular item, an innovative self-assessment is proposed. Thereby the authors aim to account for some of the mentioned shortcomings of the EQF. Originality/value This paper applies a design science paradigm to develop an ICT artefact that should support the VPL. By reflecting on the design process, the authors introduce a theoretical bridge between the O*NET and the EQF. Thereby the authors aim to account for some of the mentioned shortcomings of the EQF.},
}