Structural Funds Programmes in Wales: Evaluation Implementation Plan 2010

Transcription

1 Structural Funds Programmes in Wales: Evaluation Implementation Plan Introduction This 2010 Plan details the evaluation activity currently underway or planned to analyse the impact of and support the management and implementation of the Structural Funds Programmes in Wales. It is the third in the series of plans that WEFO is using to implement the Monitoring and Evaluation Strategy. In line with best practice, although formal mid term Programme evaluation is not a feature of this round of funding, WEFO has in place comprehensive arrangements for ongoing monitoring and evaluation of all the Welsh Structural fund Programmes. The plan encompasses the work of WEFO s Research, Monitoring and Evaluation team, the evaluations being undertaken at project level and additional independent studies, including audits and inquiries. This joined-up approach will ensure that all of the Programmes are covered in significant detail and that the overall cost is managed. Making use of the various strands is also helping to ensure that the burden on projects in particular is minimised. A matrix of the various elements that make up this comprehensive plan is at Annex A. 2. Current activity Programme Level To assure the integrity of the results and findings of the evaluation work, all research, analysis and evaluation activity is commissioned and conducted to the relevant professional standards. The scheduling of the work has also been defined to ensure that the outcomes have value and are timely in the life to the Programmes. In addition, the overall strategy allows for innovations to be introduced and for additional or specifically focussed projects to be undertaken where the need arises. For example, the re-orientation of the ESF programmes in response the economic crisis is yielding a different pattern of results delivered than was envisaged when the Programmes and the evaluation plan were developed and which is being is taken into account in the ongoing programme evaluations. A summary of the work in hand and progress to date are set out in Table 2.1. In line with the Monitoring and Evaluation Strategy the early period of the Programmes has been used to prepare for the studies to start in late 2009 / early 2010 which will provide the basis for our initial and longer term evaluation of the Programmes. In addition, a number of audits and inquiries 1

2 are underway, which focus in some detail on the Programmes implementation systems. Project Level Evaluations of the Programmes highlighted the best practice from some projects who were undertaking evaluation as part of their integrated approach to project management. In considering its approach to evaluation WEFO has made it a requirement that project sponsors evaluate their projects. All projects receiving over 2 million in grant, or that are considered risky or innovative, must be evaluated by independent contractors. This will ensure that evidence of good practice and lessons learned are robustly captured. The Monitoring and Evaluation Strategy envisaged comprehensive coverage of evaluation linking project evaluation through to programme level evaluation. To facilitate this, the strategic frameworks contained a set of evaluation questions that projects should attempt to answer within their project level evaluations. WEFO has developed comprehensive monitoring and evaluation guidance for project sponsors which is available on the WEFO website at WEFO also provides hands-on advice to project sponsors on writing their monitoring and evaluation plans and on commissioning and undertaking their project evaluations. This has been particularly intensive in the early part of the Programme period and for inexperienced sponsors but will continue from 2010 onwards to make sure that the monitoring and evaluation work is of a high standard and that the results are robust. As at January 2010 a critical mass of projects had been approved and considerable funds committed. This means that WEFO is in a position to show the direct links between the levels of evaluation envisaged in the Monitoring and Evaluation Strategy, i.e. Programme and Strategic Framework and project More information on how WEFO intends to make use of these links is included in Section 3. Annex A gives an indication of when evaluations are expected for projects that have been approved. 2

3 Table 2.1 Programme Level Evaluation Studies, Audits and Inquiries Underway Title Purpose Benefits to Programmes Timescale Impact Evaluation To consider a range of robust This study will provide the foundation for robust Draft Feasibility Study methods appropriate to use in Programme-level impact evaluation which will future evaluations of the ultimately lead to a sound understanding of the impact of the Programmes. achievements of the Programmes. March Customer Insight Survey 2009 ESF Leavers Survey Process Evaluation To obtain the views of WEFO s customers on WEFO s project handling processes. To supplement Programme monitoring data to assess the effectiveness of the ESF Convergence and ESF Competitiveness Programmes. To examine the effectiveness of Programme implementation in the Structural Funds programming period; covering Strategic Frameworks, the Cross Cutting Themes and Communications. This survey provides customer feedback to WEFO on WEFO s project handling processes, in particular, the effectiveness of new processes introduced. WEFO will use this information to indentify where improvements are to be made and where training of WEFO staff is required. This survey will provide information to WEFO on the outcomes achieved by ESF participants. The survey covers hard outcomes such as obtaining jobs or qualifications and harder to measure outcomes such as improvements in skills levels and confidence. As the survey has a longitudinal element it will provide information to WEFO on the sustainability of participants outcomes. This study will critically assess these three areas of Programme implementation to allow WEFO to determine whether the systems in place are fit for purpose and to make improvements for the second half of the programming period. This study has been designed to avoid duplication with the various audits (see below) which are also focussed on Programme processes. report received; study to be finalised by end Draft report received; study to be finalised by end March 2010 Pilot report complete; first wave report by June 2010; second wave report by December 2010 To report in summer

4 Programmes Synthesis Research Research Summaries Inquiry by the Enterprise and Learning Committee of the National Assembly for Wales into the use of EU Structural Funds in Wales Wales Audit Office Study on Implementation of EU Programmes Studies (various see Annex A for To provide a comprehensive assessment of achievements of the Programmes in Wales along with difficulties encountered in their implementation. To provide WEFO Senior Management with approximately monthly updates on published research relevant to the Structural Funds Programmes. To examine a variety of issues surrounding the implementation of the funds, focusing on the programming period. To assess whether WEFO s approach to the implementation of the Structural Funds is likely to deliver sustained impact To provide assurance to the Principal Accounting Officer and the Commission over the Building on previous lessons learned work, this review will capture the achievements, good practice and difficulties associated with the Programmes so that the lessons learned continue to be reflected in the management of the Programmes. These summaries will ensure WEFO Senior Management are adequately briefed on the findings of relevant research studies. This inquiry will provide independent scrutiny of how EU money is being managed and spent in Wales, potentially providing useful recommendations for making improvements to the current arrangements. This study will provide WEFO with an assessment of whether WEFO has the appropriate systems in place to deliver sustained impact. These audits will provide assurance that WEFO has compliant systems in place for managing the Programmes. To report in June 2010 First update to be circulated February 2010; ongoing thereafter To report in summer 2010 To report in summer 2010 To report at various stages throughout the programming 4

5 more details) risk management, control and governance arrangements used within Wales to discharge the responsibilities of the Managing and Certifying Authority period. 5

6 3. Planned activity 2010 onwards Programme Level Activity in 2010 onwards will focus on the completion of the studies discussed in Section 2 and the commissioning of a number of new pieces of work. See Table 3.1 for details of planned studies. Given that many projects are now well advanced in their delivery, it is an appropriate time to start focussing on outcomes. These will be examined primarily in the series of ongoing evaluations, as detailed in Table 3.1. Project Level As demonstrated in Annex A, a number of projects are planning to undertake interim as well as final evaluations. Many of these will start to flow in later in 2010 so, in 2011, WEFO will synthesise the findings of projects interim evaluations to report on progress of projects. Then, in 2013, when a critical mass of final project evaluations have been completed, WEFO will synthesise the findings of projects final evaluations. As noted in Section 2, WEFO has developed evaluation questions in each Strategic Framework for projects to use in their evaluations. WEFO will therefore produce synthesis reports for each Strategic Framework. These will complement the ongoing evaluations listed in Table

7 Table 3.1 Programme Level Evaluation Studies Planned Title Purpose Benefits to Programmes Timescale Ongoing Evaluation: To assess progress of the Will allow assessment of likelihood of achieving To report in June Employment Increasing Employment and objectives for key area of Increasing Employment 2010 Evaluation Strategic Value of Added Ongoing Evaluation: Enterprise Support Ongoing Evaluation: Increasing Skills Ongoing Evaluation: R&D Ongoing Evaluation: Strategic Infrastructure ERDF Business Survey Ongoing Evaluation: Support for Young People Tackling Inactivity Priorities. To assess how approved projects are proposing to achieve strategic added value. To assess progress of the Enterprise and Business Finance Priorities To assess progress of the Skills Priorities To assess progress of the R&D Priorities To assess progress of the Strategic Infrastructure Priorities To supplement Programme monitoring data to assess the effectiveness of the ERDF Enterprise and Business Finance Priorities To assess progress of the Support for Young People Priority and Tackling Inactivity. This study will determine how projects are adding value to national policies to give a better understanding of the contribution of the Programmes. Will allow assessment of likelihood of achieving objectives for key area of Enterprise and Business Finance. Will allow assessment of likelihood of achieving objectives for key area of Increasing Skills. Will allow assessment of likelihood of achieving objectives for key area of R&D. Will allow assessment of likelihood of achieving objectives for key area of Strategic Infrastructure. This survey will provide information to WEFO on the outcomes achieved by businesses assisted and financially supported by ERDF projects. Will allow assessment of likelihood of achieving objectives for key area of Support for Young People To report in June 2010 To report in autumn 2010 To report in spring 2011 To report in summer 2011 To report in autumn 2011 To report in autumn 2011 To report in spring 2012 Ongoing Evaluation: To assess progress of the Will allow assessment of likelihood of achieving To report in 7

8 Climate Change Climate Change Priority objectives for key area of Climate Change summer 2012 ESF Impact To assess the impact of the Building on the recommendations of the Impact Evaluation ESF Programmes in terms of Evaluation Feasibility Study, this evaluation will employment and skills robustly assess the impact of the ESF Programmes. outcomes Ongoing Evaluation: Modernising Public Services Ongoing Evaluation: Regeneration ERDF Impact Evaluation Further Customer Insight Surveys Further ESF Leavers Surveys To assess progress of the Modernising Public Services Priority To assess progress of the Regeneration Priorities To assess the impact of the ERDF Programmes in terms of job creation and enterprise creation and growth See Table 2.1. To be repeated on a regular basis. See Table 2.1. To be repeated on a regular basis. Will allow assessment of likelihood of achieving objectives for key area of Modernising Public Services Will allow assessment of likelihood of achieving objectives for key area of Regeneration Building on the recommendations of the Impact Evaluation Feasibility Study, this evaluation will robustly assess the impact of the ERDF Programmes. See Table 2.1. To be repeated on a regular basis. See Table 2.1. To be repeated on a regular basis. To report in summer 2012 To report in autumn 2012 To report in autumn 2012 To report in autumn 2012 See Table 2.1. To be repeated on a regular basis. See Table 2.1. To be repeated on a regular basis. 8

9 Annex A - Programme Level Evaluation Matrix Study Ex Ante Evaluations Race and Disability Equality Impact Assessments Age, Gender, Transgender, Religion and Sexual Orientation Equality Impact Assessments Impact Evaluation Feasibility Study Customer Insight Surveys ESF Leavers Surveys Process Evaluation Project Approval Time Study Programmes Synthesis Research Ongoing Evaluation: Employment Evaluation of Strategic Added Value Ongoing Evaluation: Enterprise Support Ongoing Evaluation: Increasing Skills Ongoing Evaluation: R&D Ongoing Evaluation: Strategic Infrastructure ERDF Business Survey Ongoing Evaluation: Support for Young People Ongoing Evaluation: Climate Change ESF Impact Evaluation Ongoing Evaluation: Modernising Public Services Ongoing Evaluation: Regeneration ERDF Impact Evaluation Research Summaries Key Process Impact

10 Annex A - Programme Level Evaluation Matrix Study Ex Ante Evaluations Race and Disability Equality Impact Assessments Age, Gender, Transgender, Religion and Sexual Orientation Equality Impact Assessments Impact Evaluation Feasibility Study Customer Insight Surveys ESF Leavers Surveys Process Evaluation Project Approval Time Study Programmes Synthesis Research Ongoing Evaluation: Employment Evaluation of Strategic Added Value Ongoing Evaluation: Enterprise Support Ongoing Evaluation: Increasing Skills Ongoing Evaluation: R&D Ongoing Evaluation: Strategic Infrastructure ERDF Business Survey Ongoing Evaluation: Support for Young People Ongoing Evaluation: Climate Change ESF Impact Evaluation Ongoing Evaluation: Modernising Public Services Ongoing Evaluation: Regeneration ERDF Impact Evaluation Research Summaries Key Process Impact

11 Annex A - Programme Level Evaluation Matrix Study Ex Ante Evaluations Race and Disability Equality Impact Assessments Age, Gender, Transgender, Religion and Sexual Orientation Equality Impact Assessments Impact Evaluation Feasibility Study Customer Insight Surveys ESF Leavers Surveys Process Evaluation Project Approval Time Study Programmes Synthesis Research Ongoing Evaluation: Employment Evaluation of Strategic Added Value Ongoing Evaluation: Enterprise Support Ongoing Evaluation: Increasing Skills Ongoing Evaluation: R&D Ongoing Evaluation: Strategic Infrastructure ERDF Business Survey Ongoing Evaluation: Support for Young People Ongoing Evaluation: Climate Change ESF Impact Evaluation Ongoing Evaluation: Modernising Public Services Ongoing Evaluation: Regeneration ERDF Impact Evaluation Research Summaries Key Process Impact

12 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Competitiveness ERDF 1 0 JEREMIE Fund (P1 Comp) Competitiveness ERDF 1 0 Business Innovation Support Competitiveness Competitiveness ERDF 1 0 E-Business and ICT Support (Competitiveness) Competitiveness ERDF 2 0 JEREMIE Fund (P2 Comp) Competitiveness ERDF 2 0 New Business Start Up Support (Comp) Competitiveness ERDF 2 0 Customer Engagement (Comp) Competitiveness ERDF 2 0 Business Growth (Comp) Competitiveness ERDF 2 0 North East Wales Strategic Business Parks Competitiveness ERDF 3 0 Wood Energy Business Scheme 2 Competitiveness ERDF P3 Competitiveness ERDF 3 0 Community Scale Renewable Energy (Comp) Competitiveness ERDF 3 0 Flood and Coastal Risk Management - Competitiveness Competitiveness ERDF 4 0 Severn Valley Strategic Regeneration Competitiveness ESF 1 0 ReAct ESF Competitiveness P1 Competitiveness ESF 1 0 Gateway Competitiveness ESF P1 Competitiveness ESF 1 0 Want2Work ESF Competitiveness Competitiveness ESF 1 0 Genesis Cymru Wales 2 RCE Competitiveness ESF 1 0 Competitiveness Intermediate Labour Market Programme Competitiveness ESF 1 0 Life Skills RCE Competitiveness ESF 1 0 The Peer Mentoring Programme RCE P1 Competitiveness ESF 2 0 IT for Rural Enterprises RCE Competitiveness ESF 2 0 Creative Leadership and Communication Programme Competitiveness ESF 2 0 Pro-Act Competitiveness Competitiveness ESF 3 0 Third Sector European Team ESF Competitiveness Convergence ERDF 1 1 Knowledge Exploitation Capacity Development Convergence ERDF 1 1 Knowledge Transfer And Collaborative Industrial Research Convergence ERDF 1 1 JEREMIE Fund (P1 Conv)

13 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 1 1 Institute For Life Sciences 2 Convergence ERDF 1 1 Innovation Placements Programme Convergence ERDF 1 1 Centre For Nanohealth Convergence ERDF 1 1 Business Innovation Support Convergence ERDF 1 1 Technium Pan-Wales Convergence ERDF 1 1 LCRI Convergence ERDF 1 2 ECrime Wales Convergence ERDF 1 2 ebusiness And ICT Support Convergence ERDF 1 2 Communities Two Point Zero Convergence ERDF 1 2 Digital Tourism Business Framework Convergence ERDF 2 1 New Business Start Up Support Convergence ERDF 2 1 Growth in Environmental Marine Sciences Convergence ERDF 2 1 Customer Engagement Convergence ERDF 2 1 Business Growth Convergence ERDF 2 1 Enterprise Networks Convergence ERDF 2 1 Export Assist Convergence ERDF 2 2 JEREMIE Fund (P2 Conv) Convergence ERDF 2 2 SE Wales Local Investment Fund Convergence ERDF 2 2 SW Wales Local Investment Fund Convergence ERDF 2 2 NW Wales Local Investment Fund Convergence ERDF 2 2 SIF Advance Technology Growth Fund Convergence ERDF 2 2 SIF Enhancement Areas Convergence ERDF 2 2 R D and I Financial Support for Business Convergence ERDF 3 1 Valleys Cycle Network Convergence ERDF 3 1 Quadrant Transport Interchange Convergence ERDF 3 1 BWCABUS

14 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 3 1 Central Valleys Railway Package Phase 2 Convergence ERDF 3 1 Valleys Rail Strengthening Convergence ERDF 3 2 Ebbw Vale Innovation Centre Phase 2 Convergence ERDF 3 2 Office Developments at SA1 Swansea Waterfront Convergence ERDF 3 2 South West Wales Property Development Fund Convergence ERDF 3 2 Parc Busnes Treorci Convergence ERDF 4 1 Wood Energy Business Scheme 2 Convergence ERDF 4 1 Deltastream Prototype (Stage 1) Convergence ERDF 4 1 Community Scale Renewable Energy Generation Convergence ERDF 4 2 Flood and Coastal Risk Management North West Convergence ERDF 4 2 Flood and Coastal Risk Management Central Convergence ERDF 4 2 Flood and Coastal Risk Management North East Convergence ERDF 4 2 Flood and Coastal Risk Management Pembrokeshire and Swansea Convergence ERDF 4 2 Flood and Coastal Risk Management South East Convergence ERDF 4 2 Flood and Coastal Risk Management Pan Wales Convergence ERDF 4 2 Resource Efficiency and Industrial Symbiosis Convergence ERDF 4 3 Nant Gwrtheyrn Convergence ERDF 4 3 The Development Of Angleseys Coastal Environment Convergence ERDF 4 3 Centre of Excellence for Welsh Food Convergence ERDF 4 3 Stackpole Rediscovered Convergence ERDF 4 3 Communities And Nature Convergence ERDF 4 3 ValleysRegionalPark Convergence ERDF 4 3 Heritage Tourism Convergence ERDF 4 3 Coastal Access Convergence ERDF 4 3 Sustainable Tourism Convergence ERDF 4 3 Coastal Tourism

15 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 4 3 Heads of the Valley Tourism Convergence ERDF 5 1 Physical Regeneration In North West Wales Convergence ERDF 5 1 Newbridge Regeneration Programme Convergence ERDF 5 1 Bargoed Regeneration Programme Convergence ERDF 5 1 Llanelly House Convergence ERDF 5 1 StrategicRegenerationProgrammeforBlaenauFfestiniog Convergence ERDF 5 1 The Waterfront City Convergence ERDF 5 1 The Works Convergence ERDF 5 2 Social Enterprise Support Project Convergence ERDF 5 2 Credit Union Support Project Convergence ERDF 5 2 Collaborative Communities Convergence ERDF 5 2 CRT Social Enterprise Grant Scheme Convergence ERDF 5 2 Ceredigion Social Enterprise Growth Fund Convergence ESF 1 1 A KS 3 Intervention Convergence ESF 1 1 Pupils Understanding Problems in their Locality Convergence ESF 1 1 Reach The Heights First Footholds Convergence ESF 1 1 Building The Future Together Convergence ESF 1 1 Gypsy Traveller Learning and Future Employment Project Convergence ESF 1 2 Amlwch Skills 16 plus Convergence ESF 1 2 Reach The Heights Routes To The Summit Convergence ESF 1 2 Llwyddon Lleol Creating a Culture of Enterprise amongst YP Convergence ESF 1 2 Engage Convergence ESF 2 1 Gateway Convergence ESF 2 1 BME Employment For All Convergence ESF 2 1 Family Employment Initiative Convergence ESF 2 1 JobMatch

16 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 2 1 Want2Work Connect Convergence ESF 2 1 COASTALProject Convergence ESF 2 1 South West Workways Convergence ESF 2 1 All Age Skillbuild for the Unemployed Inactive and NEET Convergence ESF 2 1 ReAct ESF Convergence P2 Convergence ESF 2 1 New Day Convergence P2 Convergence ESF 2 1 QWEST for Employment Convergence P2 Convergence ESF 2 1 STRIDES Alliance Partnership Convergence ESF 2 1 Bridges into Work A Communities Based Approach Convergence ESF 2 1 Genesis Cymru Wales 2 Convergence Convergence ESF 2 1 Life Skills Convergence Convergence ESF 2 1 North West Wales Intermediate Labour Market Programmes Convergence ESF 2 1 Cyrenians Supported Employment and Training Project Convergence ESF 2 2 Wellbeing Through Work Convergence ESF 2 2 The Peer Mentoring Programme Convergence Priority 2 Convergence ESF 3 1 Economy Convergence ESF 3 1 IT for Rural Enterprises Convergence ESF 3 1 PRO Act Convergence ESF 3 2 GO Wales Graduate Skills for the Knowledge Economy Convergence ESF 3 2 LEAD Convergence ESF 3 2 Modern Skills Diploma Convergence ESF 3 2 Foundation Degrees Convergence ESF 3 2 Software Alliance Convergence ESF 3 2 Enhancing Leadership and Management Skills Convergence ESF 3 2 Steel Training Research and Innovation Partnership (STRIP) Convergence ESF 3 2 Work Based Learning Strategies

17 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 3 2 Knowledge Economy Skills Scholarships Convergence ESF 3 2 Access to Masters Convergence ESF 3 3 Agile Nation Key Interim Final

18 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Competitiveness ERDF 1 0 JEREMIE Fund (P1 Comp) Competitiveness ERDF 1 0 Business Innovation Support Competitiveness Competitiveness ERDF 1 0 E-Business and ICT Support (Competitiveness) Competitiveness ERDF 2 0 JEREMIE Fund (P2 Comp) Competitiveness ERDF 2 0 New Business Start Up Support (Comp) Competitiveness ERDF 2 0 Customer Engagement (Comp) Competitiveness ERDF 2 0 Business Growth (Comp) Competitiveness ERDF 2 0 North East Wales Strategic Business Parks Competitiveness ERDF 3 0 Wood Energy Business Scheme 2 Competitiveness ERDF P3 Competitiveness ERDF 3 0 Community Scale Renewable Energy (Comp) Competitiveness ERDF 3 0 Flood and Coastal Risk Management - Competitiveness Competitiveness ERDF 4 0 Severn Valley Strategic Regeneration Competitiveness ESF 1 0 ReAct ESF Competitiveness P1 Competitiveness ESF 1 0 Gateway Competitiveness ESF P1 Competitiveness ESF 1 0 Want2Work ESF Competitiveness Competitiveness ESF 1 0 Genesis Cymru Wales 2 RCE Competitiveness ESF 1 0 Competitiveness Intermediate Labour Market Programme Competitiveness ESF 1 0 Life Skills RCE Competitiveness ESF 1 0 The Peer Mentoring Programme RCE P1 Competitiveness ESF 2 0 IT for Rural Enterprises RCE Competitiveness ESF 2 0 Creative Leadership and Communication Programme Competitiveness ESF 2 0 Pro-Act Competitiveness Competitiveness ESF 3 0 Third Sector European Team ESF Competitiveness Convergence ERDF 1 1 Knowledge Exploitation Capacity Development Convergence ERDF 1 1 Knowledge Transfer And Collaborative Industrial Research Convergence ERDF 1 1 JEREMIE Fund (P1 Conv)

19 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 1 1 Institute For Life Sciences 2 Convergence ERDF 1 1 Innovation Placements Programme Convergence ERDF 1 1 Centre For Nanohealth Convergence ERDF 1 1 Business Innovation Support Convergence ERDF 1 1 Technium Pan-Wales Convergence ERDF 1 1 LCRI Convergence ERDF 1 2 ECrime Wales Convergence ERDF 1 2 ebusiness And ICT Support Convergence ERDF 1 2 Communities Two Point Zero Convergence ERDF 1 2 Digital Tourism Business Framework Convergence ERDF 2 1 New Business Start Up Support Convergence ERDF 2 1 Growth in Environmental Marine Sciences Convergence ERDF 2 1 Customer Engagement Convergence ERDF 2 1 Business Growth Convergence ERDF 2 1 Enterprise Networks Convergence ERDF 2 1 Export Assist Convergence ERDF 2 2 JEREMIE Fund (P2 Conv) Convergence ERDF 2 2 SE Wales Local Investment Fund Convergence ERDF 2 2 SW Wales Local Investment Fund Convergence ERDF 2 2 NW Wales Local Investment Fund Convergence ERDF 2 2 SIF Advance Technology Growth Fund Convergence ERDF 2 2 SIF Enhancement Areas Convergence ERDF 2 2 R D and I Financial Support for Business Convergence ERDF 3 1 Valleys Cycle Network Convergence ERDF 3 1 Quadrant Transport Interchange Convergence ERDF 3 1 BWCABUS

20 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 3 1 Central Valleys Railway Package Phase 2 Convergence ERDF 3 1 Valleys Rail Strengthening Convergence ERDF 3 2 Ebbw Vale Innovation Centre Phase 2 Convergence ERDF 3 2 Office Developments at SA1 Swansea Waterfront Convergence ERDF 3 2 South West Wales Property Development Fund Convergence ERDF 3 2 Parc Busnes Treorci Convergence ERDF 4 1 Wood Energy Business Scheme 2 Convergence ERDF 4 1 Deltastream Prototype (Stage 1) Convergence ERDF 4 1 Community Scale Renewable Energy Generation Convergence ERDF 4 2 Flood and Coastal Risk Management North West Convergence ERDF 4 2 Flood and Coastal Risk Management Central Convergence ERDF 4 2 Flood and Coastal Risk Management North East Convergence ERDF 4 2 Flood and Coastal Risk Management Pembrokeshire and Swansea Convergence ERDF 4 2 Flood and Coastal Risk Management South East Convergence ERDF 4 2 Flood and Coastal Risk Management Pan Wales Convergence ERDF 4 2 Resource Efficiency and Industrial Symbiosis Convergence ERDF 4 3 Nant Gwrtheyrn Convergence ERDF 4 3 The Development Of Angleseys Coastal Environment Convergence ERDF 4 3 Centre of Excellence for Welsh Food Convergence ERDF 4 3 Stackpole Rediscovered Convergence ERDF 4 3 Communities And Nature Convergence ERDF 4 3 ValleysRegionalPark Convergence ERDF 4 3 Heritage Tourism Convergence ERDF 4 3 Coastal Access Convergence ERDF 4 3 Sustainable Tourism Convergence ERDF 4 3 Coastal Tourism

21 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 4 3 Heads of the Valley Tourism Convergence ERDF 5 1 Physical Regeneration In North West Wales Convergence ERDF 5 1 Newbridge Regeneration Programme Convergence ERDF 5 1 Bargoed Regeneration Programme Convergence ERDF 5 1 Llanelly House Convergence ERDF 5 1 StrategicRegenerationProgrammeforBlaenauFfestiniog Convergence ERDF 5 1 The Waterfront City Convergence ERDF 5 1 The Works Convergence ERDF 5 2 Social Enterprise Support Project Convergence ERDF 5 2 Credit Union Support Project Convergence ERDF 5 2 Collaborative Communities Convergence ERDF 5 2 CRT Social Enterprise Grant Scheme Convergence ERDF 5 2 Ceredigion Social Enterprise Growth Fund Convergence ESF 1 1 A KS 3 Intervention Convergence ESF 1 1 Pupils Understanding Problems in their Locality Convergence ESF 1 1 Reach The Heights First Footholds Convergence ESF 1 1 Building The Future Together Convergence ESF 1 1 Gypsy Traveller Learning and Future Employment Project Convergence ESF 1 2 Amlwch Skills 16 plus Convergence ESF 1 2 Reach The Heights Routes To The Summit Convergence ESF 1 2 Llwyddon Lleol Creating a Culture of Enterprise amongst YP Convergence ESF 1 2 Engage Convergence ESF 2 1 Gateway Convergence ESF 2 1 BME Employment For All Convergence ESF 2 1 Family Employment Initiative Convergence ESF 2 1 JobMatch

22 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 2 1 Want2Work Connect Convergence ESF 2 1 COASTALProject Convergence ESF 2 1 South West Workways Convergence ESF 2 1 All Age Skillbuild for the Unemployed Inactive and NEET Convergence ESF 2 1 ReAct ESF Convergence P2 Convergence ESF 2 1 New Day Convergence P2 Convergence ESF 2 1 QWEST for Employment Convergence P2 Convergence ESF 2 1 STRIDES Alliance Partnership Convergence ESF 2 1 Bridges into Work A Communities Based Approach Convergence ESF 2 1 Genesis Cymru Wales 2 Convergence Convergence ESF 2 1 Life Skills Convergence Convergence ESF 2 1 North West Wales Intermediate Labour Market Programmes Convergence ESF 2 1 Cyrenians Supported Employment and Training Project Convergence ESF 2 2 Wellbeing Through Work Convergence ESF 2 2 The Peer Mentoring Programme Convergence Priority 2 Convergence ESF 3 1 Economy Convergence ESF 3 1 IT for Rural Enterprises Convergence ESF 3 1 PRO Act Convergence ESF 3 2 GO Wales Graduate Skills for the Knowledge Economy Convergence ESF 3 2 LEAD Convergence ESF 3 2 Modern Skills Diploma Convergence ESF 3 2 Foundation Degrees Convergence ESF 3 2 Software Alliance Convergence ESF 3 2 Enhancing Leadership and Management Skills Convergence ESF 3 2 Steel Training Research and Innovation Partnership (STRIP) Convergence ESF 3 2 Work Based Learning Strategies

23 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 3 2 Knowledge Economy Skills Scholarships Convergence ESF 3 2 Access to Masters Convergence ESF 3 3 Agile Nation Key Interim Final

24 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Competitiveness ERDF 1 0 JEREMIE Fund (P1 Comp) Competitiveness ERDF 1 0 Business Innovation Support Competitiveness Competitiveness ERDF 1 0 E-Business and ICT Support (Competitiveness) Competitiveness ERDF 2 0 JEREMIE Fund (P2 Comp) Competitiveness ERDF 2 0 New Business Start Up Support (Comp) Competitiveness ERDF 2 0 Customer Engagement (Comp) Competitiveness ERDF 2 0 Business Growth (Comp) Competitiveness ERDF 2 0 North East Wales Strategic Business Parks Competitiveness ERDF 3 0 Wood Energy Business Scheme 2 Competitiveness ERDF P3 Competitiveness ERDF 3 0 Community Scale Renewable Energy (Comp) Competitiveness ERDF 3 0 Flood and Coastal Risk Management - Competitiveness Competitiveness ERDF 4 0 Severn Valley Strategic Regeneration Competitiveness ESF 1 0 ReAct ESF Competitiveness P1 Competitiveness ESF 1 0 Gateway Competitiveness ESF P1 Competitiveness ESF 1 0 Want2Work ESF Competitiveness Competitiveness ESF 1 0 Genesis Cymru Wales 2 RCE Competitiveness ESF 1 0 Competitiveness Intermediate Labour Market Programme Competitiveness ESF 1 0 Life Skills RCE Competitiveness ESF 1 0 The Peer Mentoring Programme RCE P1 Competitiveness ESF 2 0 IT for Rural Enterprises RCE Competitiveness ESF 2 0 Creative Leadership and Communication Programme Competitiveness ESF 2 0 Pro-Act Competitiveness Competitiveness ESF 3 0 Third Sector European Team ESF Competitiveness Convergence ERDF 1 1 Knowledge Exploitation Capacity Development Convergence ERDF 1 1 Knowledge Transfer And Collaborative Industrial Research Convergence ERDF 1 1 JEREMIE Fund (P1 Conv)

25 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 1 1 Institute For Life Sciences 2 Convergence ERDF 1 1 Innovation Placements Programme Convergence ERDF 1 1 Centre For Nanohealth Convergence ERDF 1 1 Business Innovation Support Convergence ERDF 1 1 Technium Pan-Wales Convergence ERDF 1 1 LCRI Convergence ERDF 1 2 ECrime Wales Convergence ERDF 1 2 ebusiness And ICT Support Convergence ERDF 1 2 Communities Two Point Zero Convergence ERDF 1 2 Digital Tourism Business Framework Convergence ERDF 2 1 New Business Start Up Support Convergence ERDF 2 1 Growth in Environmental Marine Sciences Convergence ERDF 2 1 Customer Engagement Convergence ERDF 2 1 Business Growth Convergence ERDF 2 1 Enterprise Networks Convergence ERDF 2 1 Export Assist Convergence ERDF 2 2 JEREMIE Fund (P2 Conv) Convergence ERDF 2 2 SE Wales Local Investment Fund Convergence ERDF 2 2 SW Wales Local Investment Fund Convergence ERDF 2 2 NW Wales Local Investment Fund Convergence ERDF 2 2 SIF Advance Technology Growth Fund Convergence ERDF 2 2 SIF Enhancement Areas Convergence ERDF 2 2 R D and I Financial Support for Business Convergence ERDF 3 1 Valleys Cycle Network Convergence ERDF 3 1 Quadrant Transport Interchange Convergence ERDF 3 1 BWCABUS

26 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 3 1 Central Valleys Railway Package Phase 2 Convergence ERDF 3 1 Valleys Rail Strengthening Convergence ERDF 3 2 Ebbw Vale Innovation Centre Phase 2 Convergence ERDF 3 2 Office Developments at SA1 Swansea Waterfront Convergence ERDF 3 2 South West Wales Property Development Fund Convergence ERDF 3 2 Parc Busnes Treorci Convergence ERDF 4 1 Wood Energy Business Scheme 2 Convergence ERDF 4 1 Deltastream Prototype (Stage 1) Convergence ERDF 4 1 Community Scale Renewable Energy Generation Convergence ERDF 4 2 Flood and Coastal Risk Management North West Convergence ERDF 4 2 Flood and Coastal Risk Management Central Convergence ERDF 4 2 Flood and Coastal Risk Management North East Convergence ERDF 4 2 Flood and Coastal Risk Management Pembrokeshire and Swansea Convergence ERDF 4 2 Flood and Coastal Risk Management South East Convergence ERDF 4 2 Flood and Coastal Risk Management Pan Wales Convergence ERDF 4 2 Resource Efficiency and Industrial Symbiosis Convergence ERDF 4 3 Nant Gwrtheyrn Convergence ERDF 4 3 The Development Of Angleseys Coastal Environment Convergence ERDF 4 3 Centre of Excellence for Welsh Food Convergence ERDF 4 3 Stackpole Rediscovered Convergence ERDF 4 3 Communities And Nature Convergence ERDF 4 3 ValleysRegionalPark Convergence ERDF 4 3 Heritage Tourism Convergence ERDF 4 3 Coastal Access Convergence ERDF 4 3 Sustainable Tourism Convergence ERDF 4 3 Coastal Tourism

27 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ERDF 4 3 Heads of the Valley Tourism Convergence ERDF 5 1 Physical Regeneration In North West Wales Convergence ERDF 5 1 Newbridge Regeneration Programme Convergence ERDF 5 1 Bargoed Regeneration Programme Convergence ERDF 5 1 Llanelly House Convergence ERDF 5 1 StrategicRegenerationProgrammeforBlaenauFfestiniog Convergence ERDF 5 1 The Waterfront City Convergence ERDF 5 1 The Works Convergence ERDF 5 2 Social Enterprise Support Project Convergence ERDF 5 2 Credit Union Support Project Convergence ERDF 5 2 Collaborative Communities Convergence ERDF 5 2 CRT Social Enterprise Grant Scheme Convergence ERDF 5 2 Ceredigion Social Enterprise Growth Fund Convergence ESF 1 1 A KS 3 Intervention Convergence ESF 1 1 Pupils Understanding Problems in their Locality Convergence ESF 1 1 Reach The Heights First Footholds Convergence ESF 1 1 Building The Future Together Convergence ESF 1 1 Gypsy Traveller Learning and Future Employment Project Convergence ESF 1 2 Amlwch Skills 16 plus Convergence ESF 1 2 Reach The Heights Routes To The Summit Convergence ESF 1 2 Llwyddon Lleol Creating a Culture of Enterprise amongst YP Convergence ESF 1 2 Engage Convergence ESF 2 1 Gateway Convergence ESF 2 1 BME Employment For All Convergence ESF 2 1 Family Employment Initiative Convergence ESF 2 1 JobMatch

28 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 2 1 Want2Work Connect Convergence ESF 2 1 COASTALProject Convergence ESF 2 1 South West Workways Convergence ESF 2 1 All Age Skillbuild for the Unemployed Inactive and NEET Convergence ESF 2 1 ReAct ESF Convergence P2 Convergence ESF 2 1 New Day Convergence P2 Convergence ESF 2 1 QWEST for Employment Convergence P2 Convergence ESF 2 1 STRIDES Alliance Partnership Convergence ESF 2 1 Bridges into Work A Communities Based Approach Convergence ESF 2 1 Genesis Cymru Wales 2 Convergence Convergence ESF 2 1 Life Skills Convergence Convergence ESF 2 1 North West Wales Intermediate Labour Market Programmes Convergence ESF 2 1 Cyrenians Supported Employment and Training Project Convergence ESF 2 2 Wellbeing Through Work Convergence ESF 2 2 The Peer Mentoring Programme Convergence Priority 2 Convergence ESF 3 1 Economy Convergence ESF 3 1 IT for Rural Enterprises Convergence ESF 3 1 PRO Act Convergence ESF 3 2 GO Wales Graduate Skills for the Knowledge Economy Convergence ESF 3 2 LEAD Convergence ESF 3 2 Modern Skills Diploma Convergence ESF 3 2 Foundation Degrees Convergence ESF 3 2 Software Alliance Convergence ESF 3 2 Enhancing Leadership and Management Skills Convergence ESF 3 2 Steel Training Research and Innovation Partnership (STRIP) Convergence ESF 3 2 Work Based Learning Strategies

29 Annex A - Project Level Evaluation Matrix Programme Priority Theme Project Convergence ESF 3 2 Knowledge Economy Skills Scholarships Convergence ESF 3 2 Access to Masters Convergence ESF 3 3 Agile Nation Key Interim Final

30 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description Enterprise and Learning Committee of the National Assembly for Wales Inquiry into the use of EU Structural Funds in Wales The purpose of the committee s inquiry is to examine a variety of issues surrounding the implementation of the funds, focusing on the programming period. Wales Audit Office Implementation of EU Programmes Annual Control Reports required under Article 62 (d) of Regulation 1083/2006. Annual Reports required under Article 53(b)(3) of Regulation 1995/2006. This audit will assess whether WEFO s approach to the implementation of the Structural Funds is likely to deliver sustained impact Annual report that summarises the audit work in the calendar year and provides an opinion on the effectiveness of the management and control systems. Annual report required by the EC that summarises any opinions provided by the audit authority. Annual Assurance Audit. Annual review that supports the regulatory reports. The review will cover the key controls used by the MA and CA and follow up on the implementation of audit recommendations. PPIMS System Development. Provision for continued attendance on the PPIMS project boards and for the provision of advice. Review of advice and guidance available to project sponsors. A review of the guidance available and to assess it for completeness and compliance with the regulations.

31 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description Review of the Project Appraisal Process. A review that will assess the effectiveness of the project selection and appraisal process to ensure only eligible and appropriate projects are approved. Review of the Project Payment Process. Review of the Draw Down Process and associated checks used by the Certifying Authority. Review of the processes used by the managing Authority to perform the on the spot verifications. Review of the recoveries process Review of the Management and Control System descriptions A review that will assess the effectiveness of the project payment process to ensure payments are made on eligible expenditure. A review of the process to ensure that only eligible amounts that have been subjected to appropriate checks are claimed from the commission. A review of the process to ensure that the on the spot checks cover all the appropriate areas and are well managed. A review of the process to ensure that all ineligible amounts are identified and subject to the correct recovery process. A review to ensure that the management and control system descriptions remain up to date and accurate. Review of how the Structural Fund Programmes are being managed and monitored in Wales. Review of the work performed by other auditors in the verification process. A review to ensure that the structural fund programmes in Wales is subject to appropriate monitoring and management procedures. A review to ensure that the work performed by auditors other than the audit authority is of a suitable standard.

32 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description IT Security Audit of main A review to ensure the main IT systems used by WEFO system(s) used by WEFO. are subject to appropriate IT controls. Review of the systems in place to ensure N+2 targets are met Review of the promotion of Structural Funds in Wales. A review to ensure that there are adequate systems in place to monitor and manage the achievement of N+2 targets A review to ensure structural funds in Wales is suitably promoted by WEFO. Review of how the cross cutting themes of equal opportunities and environmental sustainability are being managed. A review of the roles and responsibilities of the All Wales Programme Monitoring Committee. Review of how Wales is managing its responsibilities under the Ireland Wales Cross Border Programme. A review to ensure the cross cutting themes are suitably promoted and managed in structural Funds. A review to ensure the roles and responsibilities of the Programme Monitoring Committee are understood and discharged. A review to ensure WEFO meets its obligations under this objective.

33 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description A review of how WEFO is promoting the Trans-National and Inter-Regional Programmes in Wales. A review to ensure these strands of the objective are suitably promoted and managed in Wales. A review of how WEFO is managing Irregularities. A review to ensure that WEFO are administering Irregularities in compliance with EC Regulations. A review of the preparation for programme closure. A review to establish if adequate plans are being put in place to close the programmes. A review of the systems in place to manage systemic issues identified by the On the Spot Verifications and / or the Audit Authority. A review to ensure that WEFO is taking appropriate action to prevent and correct identified systemic issues. Follow up. Follow up of any systems for which an audit opinion of limited or no assurance was given (EC Key Requirement Assessment Categories 3 and 4). Follow up. Annual follow up of all Fundamental and Significant recommendations made during the previous audit year.

34 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description Enterprise and Learning Committee of the National Assembly for Wales Inquiry into the use of EU Structural Funds in Wales The purpose of the committee s inquiry is to examine a variety of issues surrounding the implementation of the funds, focusing on the programming period. Wales Audit Office Implementation of EU Programmes Annual Control Reports required under Article 62 (d) of Regulation 1083/2006. Annual Reports required under Article 53(b)(3) of Regulation 1995/2006. This audit will assess whether WEFO s approach to the implementation of the Structural Funds is likely to deliver sustained impact Annual report that summarises the audit work in the calendar year and provides an opinion on the effectiveness of the management and control systems. Annual report required by the EC that summarises any opinions provided by the audit authority. Annual Assurance Audit. Annual review that supports the regulatory reports. The review will cover the key controls used by the MA and CA and follow up on the implementation of audit recommendations. PPIMS System Development. Provision for continued attendance on the PPIMS project boards and for the provision of advice. Review of advice and guidance available to project sponsors. A review of the guidance available and to assess it for completeness and compliance with the regulations

35 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description Review of the Project Appraisal Process. A review that will assess the effectiveness of the project selection and appraisal process to ensure only eligible and appropriate projects are approved. Review of the Project Payment Process. Review of the Draw Down Process and associated checks used by the Certifying Authority. Review of the processes used by the managing Authority to perform the on the spot verifications. Review of the recoveries process Review of the Management and Control System descriptions A review that will assess the effectiveness of the project payment process to ensure payments are made on eligible expenditure. A review of the process to ensure that only eligible amounts that have been subjected to appropriate checks are claimed from the commission. A review of the process to ensure that the on the spot checks cover all the appropriate areas and are well managed. A review of the process to ensure that all ineligible amounts are identified and subject to the correct recovery process. A review to ensure that the management and control system descriptions remain up to date and accurate Review of how the Structural Fund Programmes are being managed and monitored in Wales. Review of the work performed by other auditors in the verification process. A review to ensure that the structural fund programmes in Wales is subject to appropriate monitoring and management procedures. A review to ensure that the work performed by auditors other than the audit authority is of a suitable standard.

36 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description IT Security Audit of main A review to ensure the main IT systems used by WEFO system(s) used by WEFO. are subject to appropriate IT controls Review of the systems in place to ensure N+2 targets are met Review of the promotion of Structural Funds in Wales. A review to ensure that there are adequate systems in place to monitor and manage the achievement of N+2 targets A review to ensure structural funds in Wales is suitably promoted by WEFO. Review of how the cross cutting themes of equal opportunities and environmental sustainability are being managed. A review of the roles and responsibilities of the All Wales Programme Monitoring Committee. Review of how Wales is managing its responsibilities under the Ireland Wales Cross Border Programme. A review to ensure the cross cutting themes are suitably promoted and managed in structural Funds. A review to ensure the roles and responsibilities of the Programme Monitoring Committee are understood and discharged. A review to ensure WEFO meets its obligations under this objective.

37 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description A review of how WEFO is promoting the Trans-National and Inter-Regional Programmes in Wales. A review to ensure these strands of the objective are suitably promoted and managed in Wales. A review of how WEFO is managing Irregularities. A review to ensure that WEFO are administering Irregularities in compliance with EC Regulations A review of the preparation for programme closure. A review to establish if adequate plans are being put in place to close the programmes. A review of the systems in place to manage systemic issues identified by the On the Spot Verifications and / or the Audit Authority. A review to ensure that WEFO is taking appropriate action to prevent and correct identified systemic issues. Follow up. Follow up of any systems for which an audit opinion of limited or no assurance was given (EC Key Requirement Assessment Categories 3 and 4). Follow up. Annual follow up of all Fundamental and Significant recommendations made during the previous audit year.

38 Annex A - Audits and Other Inquiries Matrix Authority Planned Audit / Inquiry Description Enterprise and Learning Committee of the National Assembly for Wales Inquiry into the use of EU Structural Funds in Wales The purpose of the committee s inquiry is to examine a variety of issues surrounding the implementation of the funds, focusing on the programming period. Wales Audit Office Implementation of EU Programmes Annual Control Reports required under Article 62 (d) of Regulation 1083/2006. Annual Reports required under Article 53(b)(3) of Regulation 1995/2006. This audit will assess whether WEFO s approach to the implementation of the Structural Funds is likely to deliver sustained impact Annual report that summarises the audit work in the calendar year and provides an opinion on the effectiveness of the management and control systems. Annual report required by the EC that summarises any opinions provided by the audit authority. Annual Assurance Audit. Annual review that supports the regulatory reports. The review will cover the key controls used by the MA and CA and follow up on the implementation of audit recommendations. PPIMS System Development. Provision for continued attendance on the PPIMS project boards and for the provision of advice. Review of advice and guidance available to project sponsors. A review of the guidance available and to assess it for completeness and compliance with the regulations