Cooperation Programme Interreg V-A –
Estonia-Latvia
Audit of the Managing Authority’s risk
assessment and management procedures
Audit No JKS-50/2022
Final Audit Report
12.09.2022
Audit of Management and Control Systems – Final Audit Report
Audit final report recipients:
Ms. Ege Ello, Head of the Managing Authority
EXECUTIVE SUMMARY
The purpose of this audit was to assess the effectiveness of the management and control systems (hereinafter as MCS) of
Cooperation Programme Interreg V-A – Estonia-Latvia 2014-2020 (hereinafter Programme) Managing Authority’s (hereinafter
as MA) risk assessment and management procedures.
The assessment was carried out on the basis of the key requirement 1 (hereinafter KR 1) as defined with the Commission
Delegated Regulation (EU) No 480/2014 and specified with the EC Guidance for the Commission and Member States on a
common methodology for the assessment of management and control systems in the Member States (EGESIF_14-0010
18/12/2014).
By compiling the final audit opinion, the auditors took into account the evidence gathered and conclusions made during the
audit work.
SUMMARY OF THE AUDIT RESULTS
As a result of this audit, the Audit Authority (hereinafter as AA) is in opinion that the MCS of the Programme
in respect of the KR11 works partially, substantial improvements are needed. (Category 32).
The assessment given to the KR does not affect the overall assessment given to the MA, that remains in
Category II.
In an overall opinion auditors concluded that MA has over the years kept the list of risks, but there is little or
no evidence to indicate that risk mitigating measures are implemented.
The MA has set up an overall risk management framework within the Description of Management and
Control Systems of the Programme (hereafter as DMCS), however it does not describe the actual procedures
of risk management. In addition to the DMCS, no detailed internal rules of procedure have been drafted and
no internal rules of procedure of the SSSC are followed by the MA regarding risk assessment and
management.
The MA has carried out a risk assessment exercise listing typical risks, but no newly emerged or significant
risks related to the programme have not been identified and assessed, e.g. fraud risks or risks indicated in
the latest system audits.
As result of 2021 risk assessment exercise more than 10 critical and conditional risks were identified, there
is no following evidence whether risk mitigation activities are carried out. No action plan has been drafted. If
significant risk mitigation activities are not carried out, it can lead to systemic errors.
There are no internal deadlines set for the programme’s risk assessment and management activities and the
timing of risk assessment exercise does not support efficient risk management.
In forming the audit opinion, in addition to the findings made, following aspects were considered:
- High error rate presented in the annual control report, indicating deficiencies in the risk management
1
KR 1: Adequate separation of functions and adequate systems for reporting and monitoring where the responsible authority entrusts execution of tasks
to another body.
AC 1.6: Taking into account the principle of proportionality, a framework for ensuring that an appropriate risk management exercise is conducted when
necessary, and in particular, in the event of major modifications to the activities and changes of the management and control structures.
2 Category 1 – Works well. No or only minor improvements needed
Category 2 – Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
2
Audit of Management and Control Systems – Final Audit Report
process.
- No actions have been taken, that auditors are aware of, to mitigate significant risks identified in the
system audits.
The detailed results by assessment criteria of the KR1 are presented in Part B of this report and the summary
table of results in Annex 1.
During the audit, the following significant3 findings were made:
Finding No 1.1 - General description of DMCS does not describe the actual procedures of risk management.
The MA has not drafted detailed risk management principles and procedures (significant)
Finding No 1.2: There are no internal deadlines set for the programme’s risk assessment and management
activities. The timing of risk assessment exercise does not support efficient risk management (significant)
Finding No 1.3 – Significant risks related to the programme have not been identified and assessed, e.g. fraud
risks (significant)
Finding No 1.4 - Assurance has not been gained whether risk mitigating activities have been implemented
(significant)
The auditors make the assumption that the information presented to them during the audit including both in written and verbal
form describe the MCS of the Programme correctly and in accordance with its actuality. Should there exist information that
was not known or not presented to the auditors at the time, the results and the opinion may have been different.
The audit has been carried out in accordance with internationally accepted internal auditing standards of the IIA – International
Standards for the Professional Practice of Internal Auditing.
The final audit report will be published at the homepage of the Ministry of Finance.
The audit team wishes to thank the employees of the Programme for their cooperation and assistance during the audit work.
Final Audit Report consists of 17 pages.
Audit supervisor: Audit manager:
(Signed electronically) (Signed electronically)
Anu Alber Elis Kõrvek
Head of Audit Unit I Lead Auditor of Audit Unit II
Financial Control Department Financial Control Department
3 Significant findings are findings that describe an error in the auditee’s MCS which has a significant effect on the possibility of fulfilling its critical tasks
and requirements (this may include systemic errors). Significant findings require immediate action from the auditee’s management in order to correct
those errors.
Non-significant findings are findings that describe an error in the auditee’s MCS which has a non-significant effect on the possibility of fulfilling its critical
tasks and requirements (this may include random errors). Non-significant findings require action from the auditee’s management in order to correct those
errors.
3
Audit of Management and Control Systems – Final Audit Report
TABLE OF CONTENTS
EXECUTIVE SUMMARY ............................................................................................................................................................. 2
TABLE OF CONTENTS .............................................................................................................................................................. 4
PART A ..................................................................................................................................................................................... 5
1. SUMMARY OF THE AUDIT WORK ………. ...................................................................... ……...................…………. ………….5
2. BACKGROUND INFORMATION ................................................................................................................... .. ………….5
3. FOLLOW-UP AND MONITORING .................................................................................................... ………………. ………….6
PART B ..................................................................................................................................................................................... 7
FINDINGS AND RECOMMENDATIONS................................................................................................. ……… ………….7
Finding No 1.1 – General description of DMCS does not describe the actual procedures of risk management. The MA has not
drafted detailed risk management principles and procedures. (significant) ..............................................................................7
Finding No 1.2 – There are no internal deadlines set for the programme’s risk assessment and management activities. The
timing of risk assessment exercise does not support efficient risk management (significant) .................................................9
Finding No 1.3 – Significant risks related to the programme have not been identified and assessed, e.g. fraud risks
(significant) .............................................................................................................................................................................11
Finding No 1.4 – Assurance has not been gained whether risk mitigating activities have been implemented (significant) ....13
ANNEX 1 – SUMMARY OPINION OF THE AUDITEE’S MCS ................................................................................ …… ……….17
4
Audit of Management and Control Systems – Final Audit Report
PART A
1. Summary of the audit work
In accordance with the Article 127(1) of the CPR and the Audit Strategy of Cooperation Programme Interreg V-A – Estonia-
Latvia, the Audit Authority carried out the system audit on the Managing Authority’s risk assessment and management
procedures.
The goal of this audit is to verify the MCS of the MA and asses the fulfilment of the assessment criteria and key requirements
defined with the Commission Delegated Regulation (EU) No 480/2014 and specified with the EC Guidance for the Commission
and Member States on a common methodology for the assessment of management and control systems in the Member States
(EGESIF_14-0010 18/12/2014) in order to express an opinion whether the MCS set up by the Programme are functioning.
This system audit has covered topics related to the following key requirements and the assessment criteria (hereinafter as AC):
KR 1: Adequate separation of functions and adequate systems for reporting and monitoring where the responsible authority
entrusts execution of tasks to another body.
AC 1.6: Taking into account the principle of proportionality, a framework for ensuring that an appropriate risk management
exercise is conducted when necessary, and in particular, in the event of major modifications to the activities and changes of
the management and control structures.
During the audit the auditors assessed whether the MA has set up an appropriate risk management framework to mitigate the
identified risks during the risk assessment exercise; whether all programme authorities have been involved in the risk
assessment exercise; whether an action plan (incl. follow-up activities, deadlines and persons responsible for the
implementation) has been drafted to mitigate the identified risks; whether the MA monitors that the activities foreseen in the
action plan have been implemented.
As it is underlined in the guidance note, the steps for the assessment methodology cover the system audits and allow auditors
to draw conclusions regarding the compliance of the system with the key requirements.
The audit was carried out between 16th of March and 12th of September 2022. The audit procedures were carried out by Lead
Auditor of Audit Unit II of the Financial Control Department of the Ministry of Finance of Estonia (hereinafter as FCD) Elis
Kõrvek, Lead Auditor of Audit Unit I of the FCD Ailen Vali and Advisor of the FCD Hannes Vahemäe. The audit supervisor was
the Head of Audit Unit I of the FCD Anu Alber.
During the audit the description of the MCS of the Programme (updated on the 6th of September 2021) was assessed and
interviews with the Head of Managing Authority, the Managing Authority’s Programme Expert responsible for the programme
risk assessment and management, the Head of the Joint Secretariat and the Head of the Estonian Financial Control were
conducted. All documents received and assessed during the audit are available in the audit file.
The audit work was based on the methodology developed by the FCD for the programming period of 2014-2020.
2. Background information
The annex XIII point 2 of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states that the
Managing Authority is responsible for a framework for ensuring that an appropriate risk management exercise is conducted
when necessary. This should also include fraud risk assessment.
The Managing Authority of the Cooperation Programme Interreg V-A – Estonia-Latvia, located in the Cross-Border Programmes
Management Division of the Grants Development Department of the State Shared Service Centre (hereafter the SSSC), is
responsible for overall management and supervision of the Cooperation Programme Interreg V-A – Estonia-Latvia, including for
ensuring that appropriate risk management procedures are implemented.
Head of the MA is responsible for the assessment of risks and implementation of action plans for risk management according
to the DMCS p. 2.1.2. The assessment of risks and preparation of action plans for risk management is also the responsibilities
5
Audit of Management and Control Systems – Final Audit Report
of the two programme experts working for the MA. According to the job description of MA programme expert p. 3.14 the
programme expert is responsible for carrying out the programme risk assessment and monitoring the timely implementation of
action plans.
According to DMCS p. 2.2.2. the programme carries out regular risk assessments. The MA is responsible for carrying out the
risk assessment at least once a year and all programme authorities except the Audit Authority are included in the process of
carrying out the risk assessment exercise. The interviews conducted with the programme authorities and material presented
during the audit gives sufficient evidence that regular risk assessments have been carried out and all programme authorities
have been involved to the risk assessment procedure by the MA, but not all programme authorities have provided their input –
identified and assessed actual risks for the next 12 months.
According to DMCS p. 2.1.4. management activities to mitigate risks are defined during the risk assessment, consisting of all
the identified risks that have higher degree (critical risks and conditional risks) and up to 5 risks with low impact that are
selected randomly, their follow-up activities, deadlines and persons responsible for the timely implementation of the action
plan. The MA coordinates the risk assessment procedure and monitors the correct implementation of management activities
to mitigate risks. There is no relevant audit trail how the MA has monitored the implementation of management activities to
mitigate risks, no action plan has been drafted.
In addition to the DMCS, no detailed internal rules of procedure have been drafted and no internal rules of procedure of the
SSSC are followed by the MA regarding risk assessment and management. The programme risk assessment results are
incorporated with the overall risk assessment of the SSSC.
For the programme in the 2014-2020 programming period, the previous relevant audit of the MCS has been a Compliance audit
of the MA (No III-2/2016) from 14th of December 2016 with an unqualified opinion on the description of the MCS.
3. Follow-up and monitoring
The auditee should take into consideration all the findings and recommendations presented in the Part B of this report. The MA
is responsible for the follow-up and monitoring of the implementation of measures taken as a result and will report of the
results in a written form. The final opinion on the implementation of measures will be given by the AA. If necessary, a follow-up
audit may be conducted.
6
Audit of Management and Control Systems – Final Audit Report
PART B
FINDINGS AND RECOMMENDATIONS4
Key requirement 1: Adequate systems for reporting and monitoring where the responsible
authority entrusts execution of tasks to another body (AC 1.65)
As a result of this audit, the auditors find that the MCS of the Programme of the MA’s risk assessment and
management procedures regarded via the KR 1 works partially; substantial improvements are needed (Category 3)
Finding No 1.1 – General description of DMCS does not describe the actual procedures of risk
management. The MA has not drafted detailed risk management principles and procedures.
(significant)
The annex XIII point 2 of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states
that the MA is responsible for a framework for ensuring that an appropriate risk management exercise is
conducted when necessary. This should also include fraud risk assessment.
Auditors assessed the MA’s risk assessment and management procedures and discovered that the DMCS is a
general description of management and control systems that does not describe the actual procedures followed by
the MA. In addition to the DMCS6, no detailed internal rules of procedure have been drafted and no internal rules of
procedure of the SSSC are followed by the MA regarding risk assessment and management.
During the audit, the MA presented a Risk Assessment Methodology (in the form of one A4 page), which
establishes the grades for risk impact and probability to calculate the risk degree. The presented document is a
translation of the risk assessment tool adopted by the Ministry of Interior of Estonia, where the MA was located
prior to 1st of September 2015.
The auditors found that the current DMCS gives misleading information about the nature of the risk management
activities performed by the MA. Auditors point out that there is a difference on how the risk management activities
are described in the DMCS and how the MA carries them out in practice. Although according to DMCS p. 2.1.4. the
MA monitors correct implementation of management activities to mitigate risks and as result of 2021 risk
assessment exercise more than 10 critical and conditional risks were identified, there is no audit trail whether the
MA monitors the implementation of management activities to mitigate risks. No action plan has been drafted.
There are no internal deadlines set for the programme’s risk assessment and management activities, the exact
schedule, responsible persons and methodology have not been established. See details in finding 1.2, 1.3 and 1.4.
RISK: There is a risk that the MA has not set up adequate risk management framework to mitigate the risks
identified during the risk assessment exercise, thus the MA fails to comply with the regulatory requirements set in
CPR.
RECOMMENDATION: The MA’s risk assessment and management principles and procedures should be drafted as
the current DMCS is a general description of management and control systems. Auditors recommend to
4 Audit findings are listed according to the order of assessment criteria of the MCS assessment methodology
5
AC 1.6: Taking into account the principle of proportionality, a framework for ensuring that an appropriate risk management exercise is
conducted when necessary, and in particular, in the event of major modifications to the activities and changes of the management and
control structures.
6
DMCS p. 2.1.4 Description of the procedures for ensuring effective and proportionate anti-fraud measures; DMCS p. 2.2.2. Framework to
ensure that an appropriate risk management exercise is conducted when necessary.
7
Audit of Management and Control Systems – Final Audit Report
implement detailed internal rules of procedure for risk management or the DMCS should be updated in more detail
that activities, deadlines, methodology and responsible parties are clearly in place. Auditors recommend adopting
the principles of conducting the risk assessment exercise made by the SSSC in case of other programmes (e.g. the
EEA and Norway Grants are included) and consider incorporating the Cooperation Programme Interreg V-A –
Estonia-Latvia as part of the SSSC overall risk management system.
COMMENT FROM THE MA:
The risks of the EE-LV programme are identified in the risk assessment matrix. The matrix includes, inter alia, the
risk management activities, deadlines, responsible Programme Authority (PA). The risk management is an inherent
component of the overall programme implementation and should not be treated as a separate issue in the
programme. The auditors say that there is no audit trail whether the MA monitors the implementation of the
management activities to mitigate the risks. The MA replies that all risks have been dealt with when they have
occurred and the risk management activities have been followed. Looking into the risk mitigation activities of
2020-2021 it can be said that all these activities are part of the everyday performance of the programme taking
into account the programme cycle. There may not be a specific audit trail for risk management activities, but when
the risk occurs, the relevant PAs work closely together to manage/mitigate the risks. There are meetings, phone
calls, e-mails on the concrete issues. Content-wise the risks have been managed although there is no single
concrete written record. Over the years, before the results of the audit of the Valga-Valka Centre project, the error
rate has been zero or below 2%. This also proves that the risk management is working. The Programme Authorities
work to ensure eligible implementation of the programme with a focus at non-materialisation of the risks.
The MA agrees that there is no action plan for the critical and conditional risks. The MA and JS discussed the issue
and it was decided not to prepare a separate action plan as it would be another document, which, taking into
account the size of the programme and limited staff, would not be reasonable. Instead, the risk assessment matrix
will be complemented. When risk materialises, immediate actions will be taken. The activities undertaken to
mitigate the risk, the result and follow-up activities will be added to the matrix. The matrix should clearly state what
is final status of the risk mitigating activity. A concrete PA with a responsible person will be added who is
responsible for taking action and follow-up regarding risk management. In this way the whole process of the risk
management can be followed.
The MA does not agree that the DMCS gives misleading information on risk management. The chapters of 2.2.2
and 2.1.4 of the DMCS provide a comprehensive description of the risk management, which includes irregularities
and fraud.
FINAL COMMENT FROM THE AUDITOR:
Auditors would like to stress the importance of ensuring appropriate risk management framework to eliminate and
minimize the identified risks. The focus should not be merely on dealing with the risks after they have occurred.
As described in more detail in finding 1.2, 1.3 and 1.4 detailed internal rules of procedure for risk management
should be implemented or the DMCS should be updated in more detail that activities, deadlines, methodology and
responsible parties are clearly in place. In the comment to the finding 1.2 the MA agrees that the risk assessment
exercise should be made more efficient and should be carried out during the same period as in the SSSC and be a
part of the SSSC risk assessment. The MA agrees to adopt more detailed risk assessment procedures and
timetable.
Auditors remain in the opinion that the chapters 2.2.2 and 2.1.4 of the DMCS currently are only general description
of the risk management procedures, and there is a difference on how the risk management activities are described
in the DMCS and how the MA carries them out in practice. Although the chapter 2.1.4 of the DMCS includes
description of procedures for anti-fraud measures and chapter 2.2.2. states that risks related to fraud are part of
the risk assessment, no fraud risks were identified by the MA in the risk matrix.
This finding will be followed up by the AA when detailed internal rules of procedure for risk management are
implemented or the DMCS is updated.
8
Audit of Management and Control Systems – Final Audit Report
Finding No 1.2 – There are no internal deadlines set for the programme’s risk assessment and
management activities. The timing of risk assessment exercise does not support efficient risk
management (significant)
According to DMCS p. 2.2.2. the programme carries out regular risk assessments in accordance with annual work
plans, at least once a year with the perspective of 12 months.
Auditors assessed the MA’s risk assessment and management procedures and discovered that there are no
internal deadlines set in the DMCS for the programme’s risk assessment and management activities, e.g. when the
risk assessment exercise is carried out, how much time is given for the programme authorities to carry out the risk
assessment, any brainstorming events planned, when the results of the risk assessment are communicated to the
programme authorities and to the top management of the SSSC, when the risk assessment follow-up activities are
monitored by the MA.
During the interviews it was clarified that the risk assessment exercise is carried out in the 1st quarter of the year
and the basis of assessment is a calendar year instead of accounting year since 2022. The overall risk assessment
of the SSSC is in the 3rd quarter.
Auditors are in the opinion that the timing of the risk assessment exercise in the 1st quarter of the year does not
support efficient risk management and should be carried out before the annual work plan and performance
analysis is drafted in the 4th quarter. As the results of risk analysis should be reflected in an action plan for follow-
up activities in case critical and conditional risks identified.
RISK: Auditors point out that there is a risk in not drafting adequate procedures and leaving the internal deadlines
clarified may lead to risk assessment and mitigation actions not being carried out in a timely manner.
RECOMMENDATION: Auditors recommend to implement detailed internal rules of procedure for risk management
or the DMCS should be updated in more detail. Auditors recommend adopting the principles of conducting the risk
assessment exercise made by the SSSC in case of other programmes (e.g. the EEA and Norway Grants are
included) and consider incorporating the Cooperation Programme Interreg V-A – Estonia-Latvia as part of the SSSC
overall risk management system.
Following aspects should be considered:
internal deadlines followed for risk assessment and management activities should be specified in the
procedures of the MA (e.g. in the DMCS);
timing of the risk assessment exercise should support efficient risk management and it should be carried
out before the annual work plan and performance analysis is drafted.
COMMENT FROM THE MA:
The MA agrees that the risk assessment exercise should be made more efficient and should be carried out during
the same period as in the SSSC, and be a part of the SSSC risk assessment. The MA will adopt the more detailed
risk assessment procedures and time-table:
The MA will organise brainstorming between all PAs of possible risks that may occur during the year n+1
year in September of the year n.
On the basis of this brainstorming, the risk matrix will be updated including mitigating activities, deadlines
and responsible persons, and the final matrix will be sent to all PAs. Further on, the time-table established
in internal rules and procedures for risk management will be followed as much as possible.
The risk assessment activity is included in the Programme work-plan, which is compiled in October.
Implementation of risk management activities will also be included.
As some of the PAs are located outside Estonia and therefore, they do not have access to electronic
environments used by SSSC, the MA together with PAs will discuss and decide the most relevant
9
Audit of Management and Control Systems – Final Audit Report
environment to keep the risk assessment matrix for implementation and monitoring of the risk
management activities by the PAs. The aim is to link the risk management activities with the programme
employees responsible for each concrete activity. During the implementation of the risk management
activity, these employees complement the matrix as regards implemented activities and results. The MA
periodically monitors the risk management process, with a special attention to conditional and critical
risks. In case of an occurrence of the risk, mitigation activities included in the risk assessment matrix will
be implemented.
More comprehensive overview about risk management will be given in the Performance Analysis prepared
by 31 January.
FINAL COMMENT FROM THE AUDITOR:
Auditors agree with the MA’s proposals to adopt more detailed risk assessment procedures and timetable as
described above. Regarding monitoring the risk management activities periodically, it should be specified in the
procedures when MA monitors (e.g. quarterly, once in a calendar year) whether the risk management activities
have been implemented.
This finding will be followed up by the AA when the MA has adopted detailed risk assessment procedures or the
DMCS is updated, and performance analysis has been performed (31st of January 2023).
10
Audit of Management and Control Systems – Final Audit Report
Finding No 1.3 – Significant risks related to the programme have not been identified and assessed,
e.g. fraud risks (significant)
According to DMCS p. 2.1.4 the programme takes into account that the time period, which the risk analysis covers,
is limited with the next 12 months, meaning that only the risks that are actual during the next 12 months are
analysed and for these risks an action plan is developed. Depending on the state of play of the programme and its
specificities, some risks that are in the model7 may not be relevant for the programme during the analysed period.
Such risks should not be included to the risk analysis.
During the audit risk assessments carried out by the MA in 2021 and 2022 were analysed. Auditors made following
observations:
Although the programme is approaching its end, in the 2021 risk assessment some operational risks
regarding applying, project assessment and contracting of projects were still included, which are no longer
relevant for the programme in period 2014-2020.
According to the DMCS p. 2.2.2. risks related to fraud are part of the risk assessment. Auditors noted that
in the risk matrix drafted by the MA no fraud risks (e.g. double funding/cross-checking of supporting
documents, inflated costs, lack of transparent tendering process/restrictive selection criteria for favoured
suppliers, undisclosed conflict of interest) were identified.
Auditors would like to point out that risks related to the findings of system audits8 are not included in the
2022 risk assessment, e.g the MA fails to adequately monitor the tasks delegated to the JS.
As a result of the interviews conducted during the audit with the programme authorities and material
presented to the auditors gives sufficient evidence that all programme authorities have been involved to
the risk assessment procedure by the MA, but not all programme authorities have provided their input –
identified and assessed actual risks for the next 12 months. Predefined risks in the risk matrix were sent
to the programme authorities for assessment via email by the MA. Some programme authorities replied
that they had no comments. Thus, no actual risk assessment was carried out and the MA has failed to
ensure that all risks related to the programme have been identified and assessed.
During the interviews the MA pointed out that one or two conditional and critical risks were introduced to
the top management of the SSSC during the overall risk assessment of the SSSC in November, but there is
no audit trail which risks were presented. Auditors would like to point out that in 2021 risk assessment
exercise more than 10 critical and conditional risks were identified.
Due to the above, the auditors consider that significant risks related to the programme have not been identified
and assessed. At the same time some risks that are not relevant for the programme in period 2014-2020 have
been assessed.
RISK: There is a risk that risk assessment exercise is formal, the MA fails to identify critical risk which may lead to
flat rate deduction on a programme level.
There is a risk that critical risks are not taken to the top management of the SSSC by the MA, thus the MA fails to
implement appropriate risk management framework.
RECOMMENDATION: Auditors recommend the MA:
to carry out a separate risk assessment for the programming period 2014-2020 and 2021-2027 as the
actual risks depend on the implementation phase of the programme;
include risks related to fraud as part of the risk assessment;
instead of predefined risk matric consider brainstorming for actual risks for the next 12 months;
7
Predefined risks by the MA in the risk matrix sent to the programme authorities for assessment.
8
The system audit no JKS-40/2020 (audit report signed on 23.12.2021).
11
Audit of Management and Control Systems – Final Audit Report
include risks related to the system and project audit findings in the risk assessment;
ensure that all programme authorities provide their input (identified and assessed actual risks for the next
12 months) in the programme risk assessment;
all conditional and critical risk should be introduced to the top management of the SSSC and audit trail
should be kept.
Auditors recommend implementing the risk assessment matrix developed by the SSSC for other programmes (e.g.
the EEA and Norway Grants are included) and incorporating the Cooperation Programme Interreg V-A – Estonia-
Latvia as part of the SSSC overall risk management system.
COMMENT FROM THE MA:
As regards title of the finding, partly this is incorrect. Critical and conditional risks have been identified and
assessed. This is true that the risk matrix currently does not include fraud risks.
The risk assessment referred to by the auditors in the first bullet point covers the period of 01.07.2020-30.06.2021.
Subsidy contracts for a couple of projects were signed in the beginning of 2021, thus applying and assessment
was still relevant in 2020. The risk assessment for 2022 does not include contracting. Applying and to certain
extent assessment may still be relevant for 2022.
The MA agrees that risks related to fraud should be brought out separately.
The risk management including fraud is described in the Performance Analysis and is not repeated here.
However, additionally the MA would like to point out that the Programme Manual provides comprehensive
information on the selection and implementation of the projects and following this information should also
minimise materialisation of the risks. The eligibility of the project partners and adequacy of the project activities is
decided on the basis of technical eligibility and quality assessment criteria. The procedures on avoidance of
double funding is described in the DMCS chapters 1.3.6 and 2.1.4. The responsibilities to check double financing
lies with the NRAs, who establish the relevant national procedures. In addition, during assessment, the JS checks
the database of other programmes implemented in Estonia and exchange information with other ETC programmes
covering the same programme territory.
The Programme Manual includes a description of the conflict of interest, which the applicants and beneficiaries
have to follow in applying for and implementing of the projects.
The procurement requirements for both Estonian and Latvian beneficiaries are also described in the Programme
Manual. Both FCs have established their procedures for checking the procurements, which are described in the
Performance Analysis and in the Annual Summaries.
Regarding adding risks identified in the system audit, the MA does not see the need to include this into the risk
matrix. The DMCS was complemented, the procedures were specified, and the results were included in the
Performance Analysis. With the view of the 2021-2027 programme the recommendations identified in the audit
report of DMSC are taken into account.
Copy from the audit report above:
• During the interviews the MA pointed out that one or two conditional and critical risks were introduced to
the top management of the SSSC during the overall risk assessment of the SSSC in November, but there is no audit
trail which risks were presented. Auditors would like to point out that in 2021 risk assessment exercise more than
10 critical and conditional risks were identified.
Due to the above, the auditors consider that significant risks related to the programme have not been identified
and assessed. At the same time risks that are not relevant have been assessed.
12
Audit of Management and Control Systems – Final Audit Report
There is a contradiction between these two quotes. The MA would like to point out that in the risk assessment of
all years, the critical and conditional risks have assessed and identified. This is seen from the risk assessment
matrix.
Replies to the Recommendations:
• to carry out a separate risk assessment for the programming period 2014-2020 and 2021-2027 as the
actual risks depend on the implementation phase of the programme;
The MA agrees that the risks for 2014-2020 and 2021-2027 should be assessed separately. However, the MA will
keep one consolidated risk matrix. The programme periods will be identified in different columns. Taking into
account of the size of the programme and limited human resources it is not reasonable to have two separate
matrixes.
• include risks related to fraud as part of the risk assessment;
The MA agrees with this recommendation. The detail of including the fraud will be discussed and decided as fraud, if
existent, should be to a large extent identified in the course of application and implementation through reporting.
• instead of predefined risk matric consider brainstorming for actual risks for the next 12 months;
The current risk matrix is based on a brainstorming. It can and will be done again, especially bearing in mind 2021-
2027 programme. Anyway, the brainstorming will result in a risk matrix. For 2022 risk assessment, comments were
received from both FCs, the MA and JS discussed the risks firstly separately and then the Head of the JS and MA
together.
• ensure that all programme authorities provide their input (identified and assessed actual risks for the next
12 months) in the programme risk assessment;
The MA agrees to this recommendation.
• all conditional and critical risk should be introduced to the top management of the SSSC and audit trail
should be kept.
The MA can introduce the conditional and critical risks to the management of the SSSC. However, the risks of the
Estonia-Latvia Programme mainly concern the programme, and do not relate so much the overall operations of the
SSSC. It is not understood how non-introduction of the critical and conditional risks to the top management hampers
the proper risk management.
FINAL COMMENT FROM THE AUDITOR:
Auditors are in the opinion that the title of the finding is correct as no fraud risks were identified and assessed,
therefore the MA has failed to comply with the annex XIII point 2 of the Regulation (EU) No 1303/2013 of the
European Parliament and of the Council, the MA is responsible for ensuring that an appropriate risk management
exercise is conducted, including fraud risk assessment. Thus, significant risks related to the programme have not
been identified and assessed.
Auditors remain in the opinion that risks related to the system and project audit findings should be included in the
risk assessment. Conditional and critical risk should be introduced to the top management of the SSSC as the
results of the risk assessment should be used to make decisions, e.g. where additional resources or management
verifications are needed. Audit trail of the risks introduced to the top management should be kept.
This finding will be followed up by the AA when the MA has conducted the 2023 risk assessment in September, and
performance analysis has been performed (31st of January 2023).
13
Audit of Management and Control Systems – Final Audit Report
Finding No 1.4 – Assurance has not been gained whether risk mitigating activities have been
implemented (significant)
According to the DMCS p. 2.1.4. the MA is responsible for monitoring the proper implementation of management
activities to mitigate risks. Management activities to mitigate risks are defined during the risk assessment,
consisting of all the identified risks that have higher degree (critical risks and conditional risks) and up to 5 risks
with low impact that are selected randomly, their follow-up activities, deadlines and persons responsible for the
timely implementation of the action plan.
Auditors are in the opinion that risks should not be randomly selected for follow-up, incl. risks with low impact as
stated in the DMCS p. 2.1.4. It should be clearly set in the procedures that critical and conditional risks are
followed up. Low risks are usually monitored regularly.
The auditors assessed the programme’s risk assessment and management activities and discovered the following:
As results of 2021 risk assessment exercise more than 10 critical and conditional risks were identified, but
there is no audit trail whether the MA monitors the implementation of management activities to mitigate
risks. No action plan has been drafted for follow-up activities, deadlines and persons responsible for the
timely implementation of the action plan.
Auditors would like to point out that risks related quality of management verifications, e.g. findings with
significant financial impact in public procurements in project audits9 have been realised. As no
performance analysis10 of the programme has not been drafted yet, there is no audit trail of risk
assessment follow-up activities. The MA has failed to ensure proper risk mitigating activities due to
insufficient monitoring.
Thus, auditors have not gained assurance that risk mitigating activities have been implemented.
RISK: There is a risk that the MA does not adequately manage risks, thus the MA fails to comply with the regulatory
requirements set in CPR. Current DMCS gives misleading information about the nature of risk management
activities.
RECOMMENDATION: The auditors recommend that adequate risk mitigating activities should be implemented.
Relevant audit trail should be kept. Following aspects should be considered:
it should be clearly specified in the procedures that critical and conditional risks are followed up. Thus,
risks should not be randomly selected, incl. risks with low impact (as stated in the DMCS p. 2.1.4.);
risk assessment follow-up activities should be implemented, incl. an action plan with deadlines and
persons responsible for the timely implementation of the action plan should be drafted by the MA for the
critical and conditional risks identified during the risk assessment exercise;
summary of the annual risk assessment results should be communicated to the programme authorities,
including measures taken regarding critical and conditional risks and identified, e.g. as a part of the
performance analysis;
the results of the risk assessment should be used to make decisions, e.g. where additional resources or
management verifications are needed.
The auditors recommend to use the internal rules of procedure of the State Shared Service Centre for risk
management in case of Cooperation Programme Interreg V-A – Estonia-Latvia and incorporating the Cooperation
Programme Interreg V-A – Estonia-Latvia as part of the SSSC overall risk management system.
9
Project audit no ELP-18/2021, project no Est-Lat 51 Valga-Valka Twin Town Centre Development.
10
Recommendation of the audit no JKS-40/2020 (audit report signed on 23.12.2021) finding no 1.1, 1.2, 8.1.
14
Audit of Management and Control Systems – Final Audit Report
COMMENT FROM THE MA:
Some of the issues described in this point have been largely tackled by AA above. The MA will improve the risk
management of the EE-LV programme as described in the above comments, mainly under Finding 1.2.
The MA is aware that a significant risk related to public procurement has realised. The MA would like to stress that
the procedures for checking the procurements are in place. The general procedures for EE and LV beneficiaries are
provided in the Programme Manual, the FCs have their own internal procedures that include involvement of
procurement experts and specific procurement checklists according to which the procurements are controlled. In
the concrete case of the Valga-Valka Centre project, the JS consulted the partners before the procurement thus
applying already the preventive measures. The first partner reports, which included the procurements, were
checked by FC and procurement expert. It should be analysed why the irregularity was not discovered in this
controlling phase.
However, based on the additional audits and past experience, the case with the Valga-Valka Centre project can be
considered as an unfortunate single case.
Replies to the Recommendations:
• it should be clearly specified in the procedures that critical and conditional risks are followed up. Thus,
risks should not be randomly selected, incl. risks with low impact (as stated in the DMCS p. 2.1.4.);
The MA agrees to the recommendation, all critical and conditional risks will be followed up. The DMCS will be
complemented respectively. Following up the risks with low impact depends on the workload of the stuff. Usually,
mitigation of such risks does not require special attention and can be done in the course of regular work.
• risk assessment follow-up activities should be implemented, incl. an action plan with deadlines and
persons responsible for the timely implementation of the action plan should be drafted by the MA for the critical
and conditional risks identified during the risk assessment exercise;
As mentioned above, after internal discussion between MA and JS, it was decided not to prepare a separate action
plan. Instead, a current risk assessment matrix will be complemented: The management activities will be made
more concrete, the result and follow-up activities will be added. The matrix should clearly state what is final status of
the risk. A concrete PA with a person will be added who is responsible for taking action and follow-up regarding a
concrete risk.
• summary of the annual risk assessment results should be communicated to the programme authorities,
including measures taken regarding critical and conditional risks and identified, e.g. as a part of the performance
analysis;
The result of annual risk assessment, i.e., the final risk assessment matrix has always been sent to Programme
Authorities. It will be done also in the future with the improved matrix.
• the results of the risk assessment should be used to make decisions, e.g. where additional resources or
management verifications are needed.
The risk assessment has been used for a decision making, for example complementing the programme documents
and identifying training needs. However, addressing the needs does not always depend on the programme
authorities e.g. recruiting additional staff.
The auditors recommend to use the internal rules of procedure of the State Shared Service Centre for risk
management in case of Cooperation Programme Interreg V-A – Estonia-Latvia and incorporating the Cooperation
Programme Interreg V-A – Estonia-Latvia as part of the SSSC overall risk management system.
The programme will bring its risk assessment procedures in line with the SSSC as much as possible and relevant.
However, it should always be taken into account that Estonia-Latvia programme involves two countries. The MA has
taken and will take part in the overall risk assessment of the SSSC, thus we have had and will have the possibility to
provide our input.
15
Audit of Management and Control Systems – Final Audit Report
FINAL COMMENT FROM THE AUDITOR:
Auditors commend the MA efforts to bring programme’s risk management procedures in line with the SSSC taking
into account the Estonia-Latvia programme specifics.
This finding will be followed up by the AA when the MA has conducted the 2023 risk assessment in September,
relevant environment to keep the risk assessment matrix for implementation and monitoring of the risk
management activities has been established and performance analysis has been performed (31st of January
2023).
16
Audit of Management and Control Systems – Final Audit Report
ANNEX 1 – Summary opinion of the auditee’s MCS
Key requirement11 Category 1 Category 2 Category 3 Category 4
Key requirement 1: Adequate separation of
functions and adequate systems for reporting
and monitoring where the responsible
authority entrusts execution of tasks to
another body
Assessment Criteria 1.6: Taking into account
the principle of proportionality, a framework X
for ensuring that an appropriate risk
management exercise is conducted when
necessary, and in particular, in the event of
major modifications to the activities and
changes of the management and control
structures.
Summary opinion of the auditee’s MCS X
11
Guidance for the Commission and Member States on a common methodology for the assessment of management and control systems in the Member
States EGESIF_14-0010-final 18/12/2014
https://ec.europa.eu/regional_policy/sources/docgener/informat/2014/guidance_common_mcs_assessment_en.pdf
17
Hr Martin Karro
Riigi Tugiteenuste Keskus Meie 12.09.2022 nr 10-5/7286-1
[email protected]
Juhtimis- ja kontrollisüsteemi
auditi lõpparuande edastamine
Austatud härra Karro
Edastame Teile „Cooperation Programme Interreg V-A – Estonia-Latvia“ juhtimis- ja
kontrollsüsteemi auditi lõpparuande nr JKS-50/2022.
Täname Teid meeldiva koostöö ja abi eest auditi läbiviimisel.
Lugupidamisega
(allkirjastatud digitaalselt)
Kaur Siruli
Finantskontrolli osakonna juhataja
Auditeeriva asutuse juht
Lisa: Auditi lõpparuanne 17 leheküljel
Sama:
Pr Ege Ello, Riigi Tugiteenuste Keskus (
[email protected]);
Pr Helena Järviste, Riigi Tugiteenuste Keskus (
[email protected]);
Hr Urmo Merila, Riigi Tugiteenuste Keskus (
[email protected]);
Pr Imbi Uusjärv, Riigi Tugiteenuste Keskus (
[email protected]);
Pr Karin Viikmaa, Riigi Tugiteenuste Keskus (
[email protected]).
Elis Kõrvek 611 3197
[email protected]
Suur-Ameerika 1 / 10122 Tallinn / 611 3558 /
[email protected] / www.rahandusministeerium.ee
registrikood 70000272