Bundesinstitut für Berufsbildung (BIBB)

Methods and Instruments for the Evaluation and Monitoring of VET Systems

Expert Workshop

Maritim Hotel Königswinter, 10 and 11 December 2009

Impressions of the event

The two international sections in BIBB "International Advisory Services" and "European VET Policies/International Benchmarking and Monitoring"  organized an expert workshop "Methods and instruments for the evaluation and monitoring of VET systems" in Königswinter. With the motto Advisory meets Research over 50 international experts in this field met to discuss and share information.The contributions addressed the following topics:

• System description                         
  A lot of more or less extensive descriptions of the genesis and development of VET systems are available. Most of them are elaborated to provide background knowledge for people who are not familiar with the respective national VET system.
• Indicators & benchmarks
  Supervising the 'status quo' or heading towards certain targets - both instruments are mainly used to compare internationally and to advise national policy makers.
  3. Peer review and peer learning
  In addition to evidence-based policy that is informed by statistics and strictly controlled methodologies of data gathering peer review and learning activities use the opinions of experts based on 'at the spot' visits. Different inbound or outbound exchanges exist as well as combinations with quantitative methodologies. Their relevance and effectiveness as regards policy impact has been discussed.

The workshop's papers and results will be published soon as Research Discussion Paper at the BIBB homepage and a follow-up workshop on this topic is planned for next year.

Thursday, 10 December 2009

• 9:00 a.m. 
  Welcome and opening
  Dr. Gisela Dybowski, BIBB
• 9:15 a.m. 
  "VET-Research and Measurement of competencies by the BMBF"
  Peter Thiele, Federal Ministry of Education and Research
  "Learning for Jobs. The OECD Policy Review of Vocational Education and Training"
  Kathrin Höckel, OECD
• 10:15 a.m.
  Aims and scope of the workshop
  Dr. Philipp Grollmann, BIBB
  Melanie Hoppe, BIBB
  
• 11:00 a.m. Workshops 1 - 3
  
  Workshop 1: System Analysis & Monitoring
  11:00 - 12:30 a.m.
  
  Challenges and Chances of a European monitoring instrument - ReferNet
  Ute Hippach-Schneider, BIBB, Germany
  The multi-faceted field of reviewing European VET Policy - challenges for comparative analyses
  Dr. Torsten Dunkel, CEDEFOP, Greece
  
  Moderation: Dr. Klaus Ruth, Institute Technology and Education, Bremen University, Germany
  
  Workshop 2: Indicators & Benchmarks
  11:00 - 12:30 a.m.
  
  Entry-level-competence Tests: A Mean for Evaluation the Fulfilment of Occupational Standards
  Prof. Dr. Marc Schütte, Hamburg University of Applied Sciences, Germany
  Prof. Dr. Georg Spöttl, Institute Technology and Education, Bremen University, Germany
  Monitoring of Qualification and Employment in Austria - an empirical approach based on the labour force survey
  Dr. Lorenz Lassnigg, Institute for Advanced Studies, Austria
  Dr. Stefan Vogtenhuber, Institute for Advanced Studies, Austria
  
  Moderation: Dr. Georg Hanf, BIBB, Germany
  
  Workshop 3: Peer Learning & Qualitative Methodologies
  11:00 - 12:30 a.m.
  
  A comparison of different peer evaluation systems
  Sandra Speer
  Qualitative Techniques for Evaluating Vocational Education and Training Systems
  Ph.D. Benjamin A. Ogwo, State University of New York, USA
  
  Moderation: Dr. Philipp Grollmann, BIBB, Germany
  
• 2:00 p.m. Workshops 1 - 3
  
  Workshop 1: System Analysis & Monitoring
  02:00 - 03:30 p.m.
  
  Result measurement and programme-based approaches
  Stefan Thomas, GTZ, Germany
  Methods and instruments for the evaluation of Vocational Education and Training systems
  Noela Eddington, VET Strategy and Research, Department of Education and Training, Australia
  Ian Eddington, University of Southern Queensland, Australia
  A Proposal of the Study on the Evaluation of Secondary Vocational School in China
  Prof. Nie Xiaorong, China National Training Base for Vocational Education Teacher, China
  Prof. Ass. Wang Ziyuan, China National Training Base for Vocational Education Teacher, China
  Prof. Ass. Pan Zibao, China National Training Base for Vocational Education Teacher, China
  
  Moderation: Prof. Dietmar Frommberger, University Magdeburg, Germany
  
  Workshop 2: Indicators & Benchmarks
  02:00 - 03.30 p.m.
  
  Using survey instruments in longitudinal evaluations of vocationally orientated higher education: problems and pitfalls
  Prof. Jim Steward, Leeds Business School, UK
  Vicky Harte, Metropolitan University, UK
  The use of large-scale administrative data sets to monitor progression from VET into Higher Education in the UK: possibilities and methodological challenges
  Dr. Geoff Hayward, University of Oxford, UK
  
  Moderation: Prof. Matthias Pilz, University Cologne, Germany
  
  Workshop 3: Peer Learning & Qualitative Methodologies
  02:00 - 03:30 p.m.
  
  Study on cost-sharing mechanisms and regulatory instruments across Europe
  Simonas Gaušas, Public Policy and Management Institute Vilnius, Lithuania
  Qualitative Evaluation of Governance Structures in VET
  Dr. Ludger Deitmer, Institute Technology and Education, Germany
  Dr. Lars Heinemann, Institute Technology and Education, Germany
  Dr. Wolfgang Wittig, Institute Technology and Education, Germany
  Prof. Felix Rauner, TVET Research Group (i:BB), Bremen University, Germany
  
  Moderation: Sören Nielsen, European Training Foundation, Torino, Italy
  
• 4:00 p.m. Workshops 1 - 3
  
  Workshop 1: System Analysis & Monitoring
  04:00 - 05:30 p.m.
  
  How to evaluate VET systems?
  Dr. Klaus Ruth, Institute Technology and Education, Germany
  Monitoring of VET systems - The perspective of comparative education
  Dr. Uwe Lauterbach, DIPF, Germany
  International Handbook on VET - draft of a modified monitoring grid
  Prof. Ute Clement, University Kassel, Germany
  Prof. Matthias Pilz, University Cologne, Germany
  
  Moderation: Dr. Philipp Grollmann, BIBB, Germany
  
  Workshop 2: Indicators & Benchmarks
  04:00 - 05:30 p.m.
  
  Methods and instruments for quality assurance of the initial and vocational education and training system in Romania
  Dana Stroie, National Centre for IVET - Development, Romania
  System Monitoring and Evaluation for Quality VET in Africa
  Dr. Theresa Ogbuanya, University of Nigeria, Nigeria
  
  Moderation: Melanie Hoppe, BIBB, Germany
  
  Workshop 3: Peer Learning & Qualitative Methodologies
  04:00 - 05:30 p.m.
  
  Gender Sensitivity in Instrument Designs and Evaluation of VET Systems
  Theodorah U. Ogali, University of PortHarcourt, Nigeria
  Evaluation of training Efficiency Factors: The Spanish Case
  Prof. Pilar Pineda, Universidad Autónome de Barcelona, Spain
  Carla Quesada, Universidad Autónome de Barcelona, Spain
  Victoria Moreno, Universidad Autónome de Barcelona, Spain
  
  Moderation: Julia Schmidt, BIBB, Germany

Friday, 11 December 2009

• 09:00 a.m.
  Moderators' meeting - discussion of the results in the thematic workshops
  Results of the thematic workshops are discussed among the moderators

• 10:00 a.m.
  Reporting from the thematic workshops and discussion 
  Moderation: Melanie Hoppe, BIBB, Germany
• 11:30 a.m. 
  Panel discussion - Perspectives for further cooperation and development
  Panel members:
  Dr. Philipp Grollmann, BIBB, Germany
  Sören Nielsen, European Training Foundation, Italy
  Dr. Torsten Dunkel, Cedefop, Greece
  Dr. Ludger Deitmer, VETNET, European Educational Research Association
   
  Moderation & Closing remarks: Michael Wiechert, BIBB, Germany