Categories
Blog

CREATE2Evaluate: Enhancing evaluation practice of Adult Education policies and programmes at regional and local levels 

Between 2017 and 2019 an ERASMUS+ ‘Competitive Regions and Employability of Adults through Education’ (CREATE) project aimed to enhance performance and efficiency in adult education by addressing the gap between EU/national strategies and local/regional implementation at adult education policy level. CREATE identified a lack of policy tools and resources to evaluate the impact of adult education (AE) interventions, policies, and initiatives across Europe. This gap was particularly acute within regions tasked with AE policy formulation and implementation to progress towards the EU pan-European target of 15% AE participation. A second project, the CREATE2Evaluate project, was supported by ERASMUS+ from 2020 to 2022 to progress these findings. 

The Create2Evaluate project and Partners 

The Create 2 evaluate project is a transnational and multi-agency collaboration seeking to enhance the efficacy and valorisation of adult education at policy and governance levels. The primary aim of the project was identifying reliable tools for adult education evaluation at various layers of governance. The project has eight organisational partners from seven countries (Belgium, Germany, Ireland, Italy, Poland, Romania, and Spain) committed to identifying and operationalising these tools.  

Click here for more information on the Eight collaborative partners 

The first meeting of the partners, hosted by the German partner lead AEWB, took place online via teams on the 12th and 13th of November 2020. The project ‘Kick-Off Meeting’ discussed the overall project implementation of the defining timelines, respective duties and activities that will take place in the following months. 

A snapshot of the first Create2Evaluate partners meeting 

IO2-Report: Mapping the Impact, Validation and Evaluation of AE Policies 

The eight partners researched and mapped their current adult education policy landscape regarding evaluation, assessment, and monitoring. Primary and secondary research was undertaken. Twenty-seven stakeholders in the field of adult education were interviewed and a key stakeholder survey was disseminated to provide thirty-six additional responses.  The project partners mapped and identified tools, methods, and resources employed to evaluate adult education programmes and initiatives throughout their regions. A mapping press release went live on the 03-03-2021. 

Stakeholder collaborative conversations in action at Maynooth University. 

Mapping Outcomes 

Mapping and research enabled the CREATE2Evaluate partners to identify the lack of a centralised systemic evaluation framework, common definitions and standards. Feedback indicated that current evaluation policy is primary focused on quantitative outputs and student specific learning outcomes, and inconsistencies were apparent among targeted groups and in non-formal evaluation provision. Additionally, it was evidenced that although copious and significant qualitative evaluation is conducted across adult education centres, this data remains relatively difficult to access due to a lack of centralised systematic overarching analysis and learner protection requirements. Thus, it is very challenging for policy makers to assess the effectiveness of their adult education policies. To view result of the consolidation of findings stemming from the mapping at country and EU level performed by partners click here (full IO2 report) 

 The CREATE2 Evaluate Toolbox:  

In response to the IO2 findings the partners collaboratively collected and developed helpful tools for the evaluation of adult education at various layers of governance. The CREATE 2 Evaluate ToolBox was conceived to ensure that local and regional policy makers from across Europe will be able to use the policy tools to better plan, design, implement and monitor AE policies with a clear vision of sustainability of public funding in AE. The selection of tools takes into account different purposes of evaluation (e.g., process, persuasive, symbolic, instrumental) as well as their place in the policy cycle. The tools are free, easily accessible and multilingual. The toolbox invites users to adopt the tools to their work realities with ease.  

The Toolbox is structured in six different areas, each with specific resources and references that sustain local policy makers in better strategizing the alignment, consistence and coherence of local lifelong learning plans to EU horizons. There are a total of 42 tools; 4 best practice recommendations; 5 networks/ Forums; 4 networks/platforms, and a collection of policy documents and strategies are available. The toolbox was officially released on the 26-09-2022. 

Overview of the Toolbox sections and tools 

                                                          
 
Click each area to view the distinctive tools and resources 

1.  Consistency of the objectives and outcomes  

2.  Programme creation at the policy/public administration level 

3.Inclusivity of AE policies and availability of AE programmes 

4. AE trainings and programmes delivery 

5. Value added stemming from the participation in AE 

6. Continuity of programme evaluation and use of its results to improve AE policies 

To view the full toolbox and additional resources click ToolBox

CREATE2Evaluate implementation Package and Green Paper 

The CREATE2Evaluate implementation Package and Green Paper are the final two components of the CREATE2Evaluate project. These two deliverables were consolidated, and the press release went live on the 19-10-22.  

The CREATE2Evaluate implementation Package consists of a training suite for the policy making target groups. It is provided as a guide, with step-by-step procedures on the use and implementation of the tools to evaluate policy interventions in the domain of AE. The Training Suite includes user-friendly and flexible training resources for policy makers. Included are guidelines on the policy evaluation tools, scenario setting and profiling tools and a users’ manual and Introduction CREATE2Evaluate ToolBox 

The CREATE2Evaluate Green Paper advances the debate and stimulates the discussion on policy formulation, implementation, and evaluation of adult education. It provides incite into the challenges and drivers that contributed to the project and the final output of the CREATE2Evaluate Toolbox.. Additionally, it considers the marginalisation of adult education and considers the context in which policy is developed and implemented in adult education, thus enhancing the awareness of the issues evident across the EU adult education landscape. Importantly it offers a critical analysis of the current landscape of adult education from the perspective of the stakeholders and considers the position of the learners. The CREATE2Evaluate resources and CREATE2Evaluate Green Paper should stimulate policy dialogue and exchange on how to advance adult education for socio-economic development and integration.  

All CREATE2Evaluate results are available in multilingual versions, free and without restrictions through the dedicated open educational resource (OER) platform. To know more about the project, the organisations involved and all resources available, please feel free to consult the Open Education Resource Platform of Create2Evaluate: www.create2evaluate.eu 

Michael Kenny is a lecturer in the Department of Adult and Community Education. He is co-director of the Higher Diploma in Further Education (HDFE), and the director of the post graduate Certificate in Programme Design and Validation (PCPDV). He is currently the Principal Investigator (PI) on 6 Erasmus+ Projects, including the CREATE2Evaluate project.  

Margaret Nugent is an associate academic, researcher and lecturer with Department of Adult and Community Education. Margaret is research associate on the Diversity and several European projects. She is a specialist in engaged methodologies, conflict intervention and peace pedagogies. 

By DACE Maynooth

This is the new blog for students, colleagues and friends of the Department of Adult and Community Education, Maynooth University. We aim to promote diversity and inclusion in education using our online platform. Guest bloggers and friends of the Department will post about their research and experiences in Education. The views expressed by the authors of individual posts do not reflect the views of the Department of Adult and Community Education Maynooth University.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s