Cooperation Programme Interreg V-A –
Estonia-Latvia
Audit of the Managing Authority’s procedures
on monitoring the tasks delegated to the
Joint Secretariat, drafting the annual
summary and management declaration
Audit No JKS-40/2020
Final Audit Report
23.12.2021
Audit of Management and Control Systems – Final Audit Report
Audit final report recipients:
Ms. Ege Ello, Head of the Managing Authority
Ms. Helena Järviste, Head of the Joint Secretariat
EXECUTIVE SUMMARY
The purpose of this audit was to assess the effectiveness of the management and control systems (hereinafter as MCS) of
Cooperation Programme Interreg V-A – Estonia-Latvia 2014-2020 (hereinafter Programme) Managing Authority’s (hereinafter
as MA) procedures on monitoring the tasks delegated to the Joint Secretariat (hereinafter JS) and drafting the annual
summary and management declaration.
The assessment was carried out on the basis of the key requirements 1, 3, 4 and 8 (hereinafter as KR1 - KR8, respectively) as
defined with the Commission Delegated Regulation (EU) No 480/2014 and specified with the EC Guidance for the Commission
and Member States on a common methodology for the assessment of management and control systems in the Member States
(EGESIF_14-0010 18/12/2014).
By compiling the final audit opinion, the auditors took into account the evidence gathered and conclusions made during the
audit work.
SUMMARY OF THE AUDIT RESULTS
As a result of this audit, the Audit Authority (hereinafter as AA) is in opinion that the MCS of the Programme
in respect of the KR1, KR3, KR4 and KR8 works, but some improvements are needed. (Category 21).
KR1: As significant proportion of responsibilities of the MA (as listed in part A 2. of the audit report and in
Annex 2 table 1) are carried out by the JS, an adequate monitoring system and procedures should be
implemented.
KR3: Clear and sufficient guidance is not provided on the programme web page to the beneficiaries.
KR4: Current description of MCS gives misleading information about the nature of on-the-spot verifications
performed by the JS and should be updated according to the actual procedures implemented.
KR8: The MA has not implemented appropriate procedures for drawing up the management declaration and
annual summary. Programme performance analysis (e.g. analysing the results of on-the-spot verifications)
should be carried out by the MA and the results should be taken into account when drafting the annual
summary and management declaration.
The detailed results by assessment criteria of the KR1, KR3, KR4 and KR8 are presented in Part B of this
report and the summary table of results in Annex 1.
During the audit, the following significant2 findings were made:
Finding No 1.1 - Monitoring the tasks delegated to the JS by the MA should be enhanced (significant)
Finding No 1.2 - There is no audit trail on the MA’s monitoring the on-the-spot verifications carried out by the
1 Category 1 – Works well. No or only minor improvements needed
Category 2 – Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
2 Significant findings are findings that describe an error in the auditee’s MCS which has a significant effect on the possibility of fulfilling its critical tasks
and requirements (this may include systemic errors). Significant findings require immediate action from the auditee’s management in order to correct
those errors.
Non-significant findings are findings that describe an error in the auditee’s MCS which has a non-significant effect on the possibility of fulfilling its critical
tasks and requirements (this may include random errors). Non-significant findings require action from the auditee’s management in order to correct those
errors.
2
Audit of Management and Control Systems – Final Audit Report
JS (significant)
Finding No 3.1 - The MA has not given appropriate guidance to the beneficiaries – how the project partners,
who are not contracting authorities of public sector should carry out purchases (significant)
Finding No 4.1 - Procedures of on-the-spot verifications implemented by the JS should be enhanced
(significant)
Finding No 8.1 - The MA has not set appropriate procedures for drawing up the management declaration and
annual summary. There is no audit trail of the performance analysis carried out and conclusions made for
drawing up the annual summary and the management declaration (significant)
The auditors make the assumption that the information presented to them during the audit including both in written and verbal
form describe the MCS of the Programme correctly and in accordance with its actuality. Should there exist information that
was not known or not presented to the auditors at the time, the results and the opinion may have been different.
The audit has been carried out in accordance with internationally accepted internal auditing standards of the IIA – International
Standards for the Professional Practice of Internal Auditing.
The final audit report will be published at the homepage of the Ministry of Finance.
The audit team wishes to thank the employees of the Programme for their cooperation and assistance during the audit work.
Final Audit Report consists of 29 pages.
Audit supervisor: Audit manager:
(Signed electronically) (Signed electronically)
Kaisa Kallas Elis Kõrvek
Head of Audit Unit II Lead Auditor of Audit Unit II
Financial Control Department Financial Control Department
3
Audit of Management and Control Systems – Final Audit Report
TABLE OF CONTENTS
EXECUTIVE SUMMARY ............................................................................................................................................................. 2
TABLE OF CONTENTS .............................................................................................................................................................. 4
PART A ..................................................................................................................................................................................... 5
1. SUMMARY OF THE AUDIT WORK ................................................................................................................ 5
2. BACKGROUND INFORMATION.................................................................................................................... 6
3. FOLLOW-UP AND MONITORING.................................................................................................................. 7
PART B ..................................................................................................................................................................................... 8
FINDINGS AND RECOMMENDATIONS...................................................................................................... 8
Finding No 1.1 - Monitoring the tasks delegated to the JS by the MA should be enhanced (significant) ...................................8
Finding No 1.2 - There is no audit trail regarding the MA’s monitoring of the on-the-spot verifications carried out by the JS
(significant) .............................................................................................................................................................................14
Finding No 3.1 - The MA has not given appropriate guidance to the beneficiaries – how the project partners, who are not
contracting authorities of public sector should carry out purchases (significant) ...................................................................16
Finding No 4.1 – Procedures of on-the-spot verifications implemented by the JS should be enhanced (significant) ..............19
Finding No 8.1 – The MA has not set appropriate procedures for drawing up the management declaration and annual
summary. There is no audit trail of the performance analysis carried out and conclusions made for drawing up the annual
summary and the management declaration (significant) ........................................................................................................21
ANNEX 1 – SUMMARY OPINION OF THE AUDITEE’S MCS ................................................................................. 25
ANNEX 2 – TASKS DIVIDED BETWEEN THE MA, JS AND FCS IN DMCS TABLE 1 ................................................. 26
ANNEX 3 – DESCRIPTION OF ON-THE-SPOT VERIFICATION BY THE JS .................................................................. 29
4
Audit of Management and Control Systems – Final Audit Report
PART A
1. Summary of the audit work
In accordance with the Article 127(1) of the CPR and the Audit Strategy of Cooperation Programme Interreg V-A – Estonia-
Latvia, the AA carried out the system audit “The Managing Authority’s procedures on monitoring the tasks delegated to the
Joint Secretariat, drafting the annual summary and management declaration”.
The goal of this audit is to verify the MCS of the MA and asses the fulfilment of the assessment criteria and key requirements
defined with the Commission Delegated Regulation (EU) No 480/2014 and specified with the EC Guidance for the Commission
and Member States on a common methodology for the assessment of management and control systems in the Member States
(EGESIF_14-0010 18/12/2014) in order to express an opinion whether the MCS set up by the Programme are functioning.
This system audit has covered topics related to the following key requirements and the assessment criteria (hereinafter as AC):
KR 1: Adequate separation of functions and adequate systems for reporting and monitoring where the responsible
authority entrusts execution of tasks to another body.
AC 1.5: Adequate procedures and arrangements are in place to effectively monitor and supervise the tasks delegated
by the responsible body (MA) to another body (JS) on the basis of adequate reporting mechanisms.
KR3: Adequate information to beneficiaries.
AC 3.1: Effective communication to beneficiaries of their rights and obligations in particular the national eligibility rules
laid down for the programme, the applicable EU rules on eligibility, the specific conditions for support for each
operation concerning the products or services to be delivered under the operation, the financing plan, the time-limit for
execution, the requirements concerning separate accounting or adequate accounting codes, the information to be kept
and communicated. The information and publicity obligations should also be clearly expressed and communicated.
KR 4: Adequate management verifications.
AC 4.2: On-the-spot verifications of individual operations may be carried out by the MA or the JS on a sample basis.
The records should describe the sampling method used, identify the operations selected, and provide an overview of
the conclusions of the verifications and the detected irregularities.
AC 4.4: Evidence should be kept of:
a. the administrative verifications and the on-the-spot verifications, including the work done and the results obtained;
b. the follow-up of the findings detected.
These records constitute the supporting documentation and information for the annual summary to be prepared by
the MA.
KR 8: Appropriate procedures for drawing up the management declaration and annual summary of the final audit
reports and of controls carried out.
AC 8.1 For the preparation of the annual summary, adequate procedures are in place to ensure:
a. an adequate review and follow-up of the final results of all audits and controls carried out by the relevant bodies for
each programme, including management verifications carried out by the MA or on its behalf by the JS and audits
carried out by or under the authority of the AA and EU audits;
b. the analysis of the nature and extent of the errors and weaknesses identified in the systems and the subsequent
follow-up to these deficiencies (corrective action taken or planned);
c. the implementation of preventive and corrective action in case of identification of systemic errors.
AC 8.2 The management declaration should be based on the annual summary, and should be drawn up in accordance
with the model set out in the relevant Commission Implementing Regulation.
AC 8.3: The work carried out in preparation of the annual summary and the management declaration should be
adequately documented.
AC 8.4: Adequate internal deadlines are set.
5
Audit of Management and Control Systems – Final Audit Report
As it is underlined in the guidance note, the steps for the assessment methodology cover the system audits and allow auditors
to draw conclusions regarding the compliance of the system with the key requirements.
The audit was carried out between 12th of March 2021 and 23rd of December 2021. The audit procedures were carried out by
Lead Auditor of Audit Unit II of the Financial Control Department of the Ministry of Finance of Estonia (hereinafter as FCD) Elis
Kõrvek and Auditor of Audit Unit II of the FCD Marten Janno. The audit supervisors were the Head of Audit Unit II of the FCD
Kadi Peets (until 31.07.2021) and Kaisa Kallas (from 01.08.2021).
During the audit the description of the MCS of the Programme (updated on the 6th of September 2021) (hereinafter as DMCS)
was assessed and interview with the Head of Managing Authority was conducted. Also materials received and assessed are
available in the audit file.
The audit work was based on the methodology developed by the FCD for the programming period of 2014-2020.
2. Background information
The MA of the Cooperation Programme Interreg V-A – Estonia-Latvia is located in the Cross-Border Programmes Management
Division of the Grants Development Department of the State Shared Service Centre. The MA is responsible for overall
management and supervision of the Cooperation Programme Interreg V-A – Estonia-Latvia.
The MA is assisted by the JS in accordance with Article 23(2) of the Regulation (EU) No 1299/2013 when carrying out its tasks.
The JS is located in the Tartu office of the State Shared Service Centre. The MA and the JS are located in the same division,
the Head of the MA is the Head of the Division and the Head of the JS works under direct subordination of the Head of the MA.
According to the DMCS p. 2.1.3 (see Table 1 of DMCS, included as Annex 2 to the audit report) following functions are
delegated3 by the MA to the JS:
the JS acts on behalf of the MA as the main contact point for project partners and is daily involved in providing
support to the implementation of projects. The JS organizes seminars for beneficiaries and participates at project
kick-off meetings;
the JS provides assistance and information to project partners when generating a project idea;
the JS checks de minimis thresholds of Estonian project partners from Estonian State Aid and De Minimis Aid
Registry;
the JS supports the work of Monitoring Committee;
the JS ensures that the data is collected, entered and stored in eMS ;
the JS drafts, implements and amends the communication strategy of the programme;
the JS provides access via the programme website to relevant information about the programme implementation;
the JS ensures availability of the information that is relevant to project partners and applicants, and the application
and implementation of projects according to the programme rules and respective legal acts;
the JS drafts and implements appropriate project selection procedures and criteria;
the JS checks revenue generation;
the JS checks the progress of project activities and carries out on-spot-verifications (large investments are always
visited at least twice).
In addition to the DMCS, internal rules of procedure of the State Shared Service Centre are followed regarding certification of
payment claims and reimbursement to beneficiaries. No detailed internal rules of procedure are followed by the MA when
carrying out on-the-spot verifications or for drawing up the management declaration and annual summary.
3
According to the DMCS p. 2.1.3. the MA does not delegate its tasks to intermediate bodies in accordance with Article 123(6) and (7) of Regulation (EU)
No 1303/2013.
6
Audit of Management and Control Systems – Final Audit Report
3. Follow-up and monitoring
The auditee must take into consideration all the findings and recommendations presented in the Part B of this report. The MA
is responsible for the follow-up and monitoring of the implementation of measures taken as a result and will report of the
results in a written form. The final opinion on the implementation of measures will be given by the AA. If necessary, a follow-up
audit may be conducted.
7
Audit of Management and Control Systems – Final Audit Report
PART B
FINDINGS AND RECOMMENDATIONS4
Key requirement 1: Adequate systems for reporting and monitoring where the responsible
authority entrusts execution of tasks to another body (AC 1.55)
As a result of this audit, the auditors find that the MCS of the Programme of the MA’s procedures on monitoring
the tasks delegated to the JS regarded via the KR 1 works, but some improvements are needed (Category 2)6
Finding No 1.1 - Monitoring the tasks delegated to the JS by the MA should be enhanced
(significant)
The article 72 (e) of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states that
the MCS shall provide systems for reporting and monitoring where the body responsible entrusts execution of
tasks to another body.
As the auditors assessed the MA’s procedures on monitoring and supervising the tasks delegated to the JS, they
discovered the following:
The JS asks for the advice of the MA in case of difficult problems. Daily cooperation takes place via e-mail,
phone, online meetings. The JS has forwarded the correspondence with the MA regarding difficult cases
on 11.11.2021 to the AA.
Monthly meetings between all programme authorities take place in order to exchange information.
Minutes of the meetings are kept by the MA.
According to the DMCS the MA uses the risk analysis to analyse the work of the JS at least once a year,
carries out preparatory work and after that visits the JS. There is no audit trail of the MA’s analyse of the
work of the JS (tasks delegated to the JS as listed in part A 2. of the audit report and in Annex 2 table 1).
According to the DMCS the JS ensures that the data is collected, entered and stored in eMS, but it is not
specified whether the MA performs checks on the quality of data collected, entered and stored in eMS.
There is no relevant audit trail how the MA has gained assurance on the reliability of the data relating to
indicators, milestones and the progress of the programme.
The auditors found that, in addition to the principles described above, there are no additional internal rules of
procedure or arrangements in place which would define the scope and frequency of the monitoring done by the MA
to effectively monitor and supervise the tasks delegated to the JS. Thus, the auditors are in the opinion that the MA
has failed to demonstrate proper monitoring of its delegated functions. As significant proportion of responsibilities
of the MA (as listed in part A 2. of the audit report and in Annex 2 table 1) are carried out by the JS, an adequate
monitoring system and procedures should be implemented. Current DMCS gives misleading information about the
nature of the monitoring activities performed by the MA. Auditors point out that there is a difference on how the
monitoring activities are described in the DMCS and how the MA carries them out in practice.
4 Audit findings are listed according to the order of assessment criteria of the MCS assessment methodology
5
AC 1.5: Adequate procedures and arrangements are in place to effectively monitor and supervise the tasks delegated by the responsible
body (MA) to another body (JS) on the basis of adequate reporting mechanisms (review of the JS’s methodology, regular review of results
reported by the JS, including where possible reperformance on a sample basis of the work carried out by the JS).
6 Category 1 – Works well. No or only minor improvements needed
Category 2 – Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
8
Audit of Management and Control Systems – Final Audit Report
RISK: There is a risk that that the MA, in its supervisory capacity, fails to obtain assurance that the tasks delegated
to the JS have been properly carried out. Thus, the MA does not comply with the key regulatory requirements set in
CPR, to give reasonable assurance of the legality and regularity of the expenditure co-financed under the
programme.
RECOMMENDATION: Procedures and arrangements are set in the DMCS in a very limited part to monitor the tasks
delegated to the JS, therefore monitoring of the tasks of the JS by the MA should be enhanced. Auditors
recommend to implement detailed internal rules of procedure for monitoring the tasks delegated to the JS and the
DMCS should be updated in more detail. Auditors recommend adopting the principles of conducting the
performance analysis (toimivusanalüüs)7 made by the State Shared Service Centre (hereinafter SSSC) in case of
other programmes (e.g. the EEA and Norway Grants are included) or consider adding Cooperation Programme
Interreg V-A – Estonia-Latvia as part of current performance analysis of the SSSC.
Following aspects should be considered:
the principles of conducting a performance analysis should be drafted by the MA;
audit trail of the MA’ s monitoring activities should be kept;
as a result of the programme performance analysis the corrective measures should be implemented, e.g.
trainings for beneficiaries or staff of the MA and the JS;
results of the programme performance analysis should be taken into account when compiling the annual
summary and management declaration.
COMMENT FROM THE MA:
Monitoring the tasks delegated to the JS by the MA should be enhanced
The teams of MA and JS work in close contact. Both teams are located in the State Shared Service Centre. The MA
and the JS are in the same division in Grants Development Department, the Head of the MA is the Head of the
Cross-Border Co-operation Programmes Management Division and the Head of the JS works under direct
subordination of the Head of the MA. Also, the MA acts as the certifying authority, working in close contact with
the Grants Payments Department.
The basis of the work of JS, is the Regulation (EU) No 1299/2013 of the European Parliament and of the Council of
17 December 2013 on specific provisions for the support from the European Regional Development Fund to the
European territorial cooperation goal, according to which the joint secretariat shall assist the managing authority
and the monitoring committee in carrying out their respective functions. The joint secretariat shall also provide
information to potential beneficiaries about funding opportunities under cooperation programmes and shall assist
beneficiaries in the implementation of operations. Thus, the operation of the EE-LV MA and the JS is not
comparable to the situation where the MA has delegated tasks to the IB, as the legal basis for the operation of the
JS is different and the authorities are located in the same division in SSSC.
MA annually carries out risk analyses, where the risks related to the personnel and work loads of different
programme authorities are always included, MA stores the files related to risk assessments in the network drive of
SSSC. As it is described in the DMCS, checks can be carried out either in the eMS or on site in the premises of the
respective programme authority. As by now the data and work processes can be followed in the eMS information
system, there is no need to visit the premises of programme authorities anymore, MA updates the DMCS chapter
2.2.3. “Description of procedures” on page 28 accordingly:
“The following means are used:
1. The MA uses the risk analysis to analyse the work of the JS at least once a year, carries out
preparatory work and after that visits the JS. Depending on the topic and findings the MA and depending on
7
State Shared Service Centre work procedures for the period 2014-2020 p. 2.2.1.
9
Audit of Management and Control Systems – Final Audit Report
the outcomes may meet the staff of the whole JS or only the Head of the JS to discuss and implement the
follow-up activities. This activity is one of the inputs to annual updating of the DMCS.”
As regards Table 1 of the DMCS, where the division of tasks is divided between the MA, JS and FCs, MA will add an
explanatory legend needed to understand the table: (1) parties, who carry main responsibility for the task, are
marked with capital “X“ in bold; (2) parties, who are involved in the tasks, are marked with “x”.
10
Audit of Management and Control Systems – Final Audit Report
As regards monitoring the JS tasks, the MA has reviewed its procedures, and to consolidate the data into one single performance analysis (similarly to mainstream
structural funds: toimivusanalüüs) and create more visible audit trail, is adding information to the DMCS to explain the following logic of monitoring the delegated
tasks:
Risk assessment Follow-up activities of eMS data Monthly review meeting Exchange of information,
audits ad hoc problems
MA follow-up activities
MA ongoing follow-up activities
MA analysis, action plan and audit trail
Stage I: deadline 31 May Stage II: deadline 31 January
Updating and check of the MA analysis and action plan, incl: Updating and check of the MA analysis and action plan, incl:
Check of follow-up activities of risk assessment Check of follow-up activities of risk assessment
Check of indicators base data: 10% of progress reports Check of follow-up activities of audits
Verification of on-the-spot check-lists: 10% of check-lists
Annual Implementation Report Annual Accounts, Annual Summary, Annual Work Plan
Management Declaration
11
Audit of Management and Control Systems – Final Audit Report
MA uses the following sources for monitoring the tasks of the JS:
Risk assessment, which is carried out annually with the participation of all programme authorities except
the Audit Authority, to assess and mitigate risks related to programme and project implementation,
potential conflict of interest, irregularities, fraud etc.
Audit reports, including Audit Authority’s recommendations and follow-up activities.
Data that is stored in the eMS, where:
o Managing Authority can see and monitor the length of processes, the existence of indicator base
data, checklists filled in by FC and JS, on-the-spot checklists etc.
o MA expert responsible for CA certification of the payment claims, when certifying that the
statement of expenditure is accurate, results from reliable accounting systems and is based on
verifiable supporting documents, fills in certification checklist that includes a question about on
the spot checks: “The MA/JS has conducted the technical check, assessment and on the spot
checks adequately.”
Each time the MA notices a problem, it is the task of the MA to find solutions, manage the risks
and make sure that proper and eligible implementation of the programme is ensured. So far there
have been no problems with the on the spot checklists.
Exchange of information, ad hoc problems: when MA consults the JS via e-mail, the e-mails are stored to
project folders in X drive /server.
There are regular monthly review meetings between programme authorities. Before the meeting the Head
of the JS submits a written overview about the implemented JS tasks and matters that need the attention
of the programme authorities. During these meetings those matters (including on-the-spot checks) are
discussed, and, if relevant, next steps and follow-up activities and deadlines are agreed. Minutes of the
meeting are taken by the MA.
MA ongoing activities, as regards analysis and action plan of the monitoring activities of delegated tasks,
consists of two stages, as brought out in the table above. During stage I, with deadline on 31 May, MA reviews
analysis for the performance analysis, including data from risk assessment and eMS base data about
indicators. During stage II, with deadline on 31 January, MA reviews analysis for the performance analysis,
including data from risk assessment, audit reports and eMS base data about on-the-spot checks. If necessary,
also other data is updated in the performance analysis and action plan for follow-up activities.
The performance analysis is updated twice a year, and rolls on from one calendar year to another, serving as
input to the following documents:
Annual Implementation Report;
Annual Accounts, Annual Summary, Management Declaration;
Annual Work Plan;
Action plan for follow-up activities, related to the delegation of MA tasks, problems and risks that have
appeared.
Different versions of the performance analysis are stored in X-folder of the SSSC.
When carrying out its tasks, MA can use the help of SSSC and Estonian Ministry of Finance experts in the
fields of procurements, construction, legal, state aid etc. The staff of the programme authorities can
participate in the trainings of Interact, to improve knowledge about specifics related to the implementation of
cross-border programmes.
12
Audit of Management and Control Systems – Final Audit Report
FINAL COMMENT FROM THE AUDITORS:
Auditors would like to stress the importance of implementing adequate monitoring system and procedures as
significant proportion of responsibilities of the MA (as listed in part A 2. of the audit report and in Annex 2 table 1)
are carried out by the JS.
1. Auditors agree with the MA’s argument that as the MA and the JS are in the same division in Grants
Development Department, the Head of the MA is the Head of the Cross-Border Co-operation Programmes
Management Division and the Head of the JS works under direct subordination of the Head of the MA, the
operation of the EE-LV MA and the JS is different from the situation where the MA has officially delegated
tasks to the IB. But as the JS is physically situated in another city and significant proportion of the
responsibilities of the MA (as listed in part A 2. of the audit report and in Annex 2 table 1) are carried out
by the JS - the JS fulfils the tasks of the MA according to the Regulation (EU) No 1303/2013 of the
European Parliament and of the Council, then adequate monitoring of the tasks implemented by the JS is
essential.
2. Current annual risk analysis performed by the MA does not contain analysis of the tasks delegated to the
JS. For example, there are no risks related to reliability of the data collected, entered and stored in eMS by
the JS, quality of on-the-spot checks carried out etc. Therefore, it cannot be considered sufficient evidence
that the MA has analysed the tasks carried out by the JS. As a result of analysis action plan for follow-up
activities should be drafted in case any high risks are identified.
3. From the description provided by the MA in the audit report page 12 it is not clear how the tasks delegated
to the JS will be analysed in the performance analysis. Therefore, auditors recommend adopting the
principles of conducting the performance analysis (toimivusanalüüs)8 made by the SSSC or consider
adding Cooperation Programme Interreg V-A – Estonia-Latvia as part of current performance analysis of
SSSC. Following aspects should be considered when conducting the performance analysis:
*any changes in the management of control systems during the relevant period and assessment of the MA
regarding the functioning of MCS;
*impact of the COVID-19 pandemic, delays in project implementation;
*checks made by the MA and conclusions related to reliability of the data in eMS;
*summary of the annual risk assessment results including measures taken regarding moderate and high-
risks identified;
*summary of trainings provided to the staff of JS, FC, MA and beneficiaries, including identifying the future
training needs;
*summary of complaints received regarding financial correction decisions;
*overview of financial correction decisions during the relevant period;
*overview of irregularities, including the need to report to OLAF;
*overview of procurements checked and results;
*overview of checks made regarding payment claims, any (systemic/significant) problems identified;
*overview of checks made regarding on-the-spot checks carried out by the JS and the FC, including
assessment of results of verifications and impact on the MCS and legality and regularity of the
expenditure entered in the accounts.
4. MA’s annual work plan has been added as a new element to the DMCS (page 11 in the audit report).
Auditors recommend that the principles of drafting the annual work plan should be added to the DMCS,
including the added value it creates. The results of the performance analysis should be taken into account
when drafting the annual work plan.
This finding will be followed up by the AA when the DMCS is updated and performance analysis has been
performed.
8
State Shared Service Centre work procedures for the period 2014-2020 p. 2.2.1.
13
Audit of Management and Control Systems – Final Audit Report
Finding No 1.2 - There is no audit trail regarding the MA’s monitoring of the on-the-spot
verifications carried out by the JS (significant)
In accordance with the article 125 (4) (a) of the Regulation (EU) No 1303/2013 of the European Parliament and of
the Council, the MA shall verify that the co-financed products and services have been delivered. The article 125
point 5 (b) of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states that the
verifications include on-the-spot verifications of operations and may be carried out on a sample basis.
As the auditors assessed the procedures for on-the-spot verifications the auditors discovered that the DMCS is a
general description of management and control systems that does not describe the actual procedures followed by
the MA. The detailed internal rules of procedure9 for on-the-spot verifications of the SSSC are not followed by the
MA in case of Cooperation Programme Interreg V-A – Estonia-Latvia.
According to the DMCS, the on-the-spot verifications are performed by the JS (besides the Financial Control
hereinafter the FC)) and the following aspects are checked: whether the activities have been carried out as
planned, whether the publicity requirements have been followed. Verifications are not carried out on a sample
basis. High-risk projects are checked at least once during the project implementation. The MA may carry out a
systemic verification in cooperation with the JS if risks are identified during risk assessment (e.g in relation to
public procurements).
In period 2014-2020 no on-the-spot verifications were carried out by the MA in addition to the verifications made by
the JS. Furthermore, there is no audit trail available how the MA has monitored and analysed the results of on-the-
spot verifications of operations carried out by JS and the FC, which would provide an overview of project
implementation and indication of any changes needed in the DMCS.
RISK: There is a risk that the MA does not properly monitor the results of on-the-spot verifications of operations
performed by the JS, thus the MA fails to comply with the key regulatory requirements set in CPR. Current DMCS
gives misleading information about the nature of this control.
RECOMMENDATION: Auditors recommend to implement detailed internal rules of procedure for carrying out on-
the-spot verifications of operations10. The MA should draft in cooperation with the JS detailed internal rules of
procedure for carrying out on-the-spot verifications of operations. Following aspects should be considered:
annual on-the-spot control plan should be drafted and approved by the MA;
the persons carrying out on-the-spot controls should be defined (e.g. involvement of construction experts)
as well as the role of the MA or delegated bodies;
principles on-the-spot controls with prior notification;
principles on-the-spot controls undertaken without prior notice;
principles of online verifications for on-the-spot checks during pandemic times;
procedures to be followed in case irregularities are found, follow up on findings detected;
internal deadlines for completing the on-the-spot reports and entering the results to eMS;
the MA monitors the implementation of the annual on-the-spot control plan, audit trail is kept any changes
made.
The MA analyses the results of on-the-spot checks and decides on further need for on-the-spot checks.
The auditors recommend to use the internal rules of procedure11 of the State Shared Service Centre for on-the-spot
verifications of operations in case of Cooperation Programme Interreg V-A – Estonia-Latvia.
9
State Shared Service Centre work procedures for the period 2014-2020 p. 3.2.3.
10
Verifications are undertaken on the project's physical progress, delivery of the products, services and works, publicity rules, accounting
system, and related documentation.
11
State Shared Service Centre work procedures for the period 2014-2020 p. 3.2.3.
14
Audit of Management and Control Systems – Final Audit Report
COMMENT FROM THE MA:
Audit trail regarding the MA’s monitoring of the on-the-spot verifications carried out by the JS
DMCS is being reviewed and updated to add information about the MA performance analysis, review and
monitoring activities: data related to on-the-spot visits is analysed by MA in the frames of updating and check
of the MA analysis and action plan with the deadline on 31 January annually. The results of the analysis serve
as an input for the Annual Implementation Report, Annual Accounts, Annual Summary, Management
Declaration, Annual Work Plan and action plan for the implementation of follow-up activities deriving from the
analysis. Additionally, the analysis is updated annually by 31 May, and if necessary, topics related to on-the-
spot visits are updated in the frames of this stage.
Please see updated description of of-the-spot visits by the JS for the DMCS in Annex 3 to the audit report.
In addition:
o It is the task of the JS to make plans for on-the-spot visits. All projects are divided between the
consultants and they are responsible for annual plan for visiting their respective projects. The use of
construction experts (SSSC staff member in Estonia, external expert in Latvia) is planned to the annual
budgets of the programme technical assistance.
o Principles of online verifications for on-the-spot checks during pandemic times were discussed during
programme authorities meeting and communicated to programme authorities via e-mail, these
principles are part of the procedure, now added to the DMCS.
o JS and FCs provide monthly review about their tasks, including on the spot visits during the monthly
meetings of programme authorities, where also problems that have risen are discussed.
o Where irregularities are found, follow up activities are carried out in accordance with the DMCS,
programme Manual and its Annex 6. Guidelines to Financial Corrections.
FINAL COMMENT FROM THE AUDITOR:
The auditors have reviewed the MA’s proposals regarding updated description of on-the-spot visits by the JS for
the DMCS in Annex 3 to the audit report, but would like to point out that following aspects are essential for
adequate monitoring by the MA of on-the-spot visits carried out by the JS (currently not covered in the MA’s
proposals regarding updated description of on-the-spot visits by the JS) and therefore should be implemented:
• the MA should approve the annual on-the-spot control plan drafted by the JS;
• the MA analyses the results of on-the-spot checks and decides on further need for on-the-spot checks.
Auditors recommend to keep a relevant audit trail regarding the analyses done by the level on MA and the approval
process of on-the-spot control plan
This finding will be followed up by the AA when the DMCS is updated (including the principles of online
verifications for on-the-spot checks during pandemic times) and performance analysis has been performed.
15
Audit of Management and Control Systems – Final Audit Report
Key requirement 3: Adequate information to beneficiaries (AC 3.1)12
As a result of this audit, the auditors find that the MCS of the Programme on the MA’s procedures on monitoring
the tasks delegated to the JS via the KR3 works, but some improvements are needed (Category 2)
Finding No 3.1 - The MA has not given appropriate guidance to the beneficiaries – how the project
partners, who are not contracting authorities of public sector should carry out purchases
(significant)
The article 125 p.3 (c) of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states
that the MA shall ensure that the beneficiary is provided with a document setting out the conditions for support for
each operation including the specific requirements concerning the products or services to be delivered under the
operation, the financing plan, and the time-limit for execution.
As the auditors assessed the guidance given to the beneficiaries and discovered the following:
According to the Programme manual p. 5.5.2 NGOs are regarded as contracting authorities in case they
receive public financing over 50% of the budget. The court decisions 3-7-2718; C-155/19, C-156/19 have
changed this concept. Thus, entities are considered as contracting authorities only in case they fulfil tasks
of public which are be prescribed directly by law or on the basis of law or be inferred from a rule of law by
interpretation, e.g. emergency rescue services.
There is no reference to Structural Assistance Act or Public Procurement Act at the web page of
Cooperation Programme Interreg V-A – Estonia-Latvia https://estlat.eu/en/for-projects/guiding-
documents#.
Currently clear and sufficient guidance is not provided on the programme web page to Estonian and Latvian
beneficiaries. Special attention should be given to ensuring that the beneficiaries are aware of the regulations they
are obliged to follow.
RISK: There is a risk that NGOs who are not carrying out public tasks still regard themselves as contracting
authorities as the guidelines have not been updated and carry out public procurements (for example, MTÜ Lääne-
Eesti Turism in project no Est-Lat 22 “Coastal Hiking”, audit no ELP-19/2021). Thus, any irregularities found
regarding procurements carried out may lead to ineligible costs. Furthermore, this practice increases unnecessary
administrative burden for entities who should not be regarded as contracting authorities.
There is also a risk that information regarding relevant regulations is not clearly communicated and made easily
accessible at the programme web page to the beneficiaries.
RECOMMENDATION:
Programme manual p. 5.5.2 should be updated in the light of court decisions 3-7-2718; C-155/19, C-156/19.
Regarding the period 2021+, already during the project application assessment phase it should be determined
whether the beneficiary is a contracting authority or not and it should be clearly communicated to the beneficiaries
which procurement rules they should apply.
Auditors also recommend adding references to Structural Assistance Act or Public Procurement Act at the web
page of Cooperation Programme Interreg V-A – Estonia-Latvia under guiding documents. The MA should ensure
that also regulations applicable to Estonian and Latvian beneficiaries are available on the programme web page.
12 AC 3.1: Effective communication to beneficiaries of their rights and obligations in particular the national eligibility rules laid down for the
programme, the applicable EU rules on eligibility, the specific conditions for support for each operation concerning the products or services
to be delivered under the operation, the financing plan, the time-limit for execution, the requirements concerning separate accounting or
adequate accounting codes, the information to be kept and communicated. The information and publicity obligations should also be clearly
expressed and communicated.
16
Audit of Management and Control Systems – Final Audit Report
COMMENT FROM THE MA:
Updating of the programme manual p. 5.5.2 in the light of court decisions 3-7-2718; C-155/19, C-156/19:
As regards the court decisions 3-7-2718; C-155/19, C-156/19, the information will be taken into account for the
next programming period, when MA and JS in cooperation with other parties, including Audit Authority, describe
the rules in the new period programme Manual. These rules will include information about which organisations are
contracting authorities and which are not. During the current period there is one project partner, to whom these
rules apply, JS has contacted the respective partner to explain change in the requirements and related obligations
and audit trail of the project partner.
In addition, we have discussed the need to improve exchange of information in the SSSC and we have agreed that
information about court cases that change implementation rules are always communicated to the Managing
Authority from the SSSC lawyers team.
Adding references to Structural Assistance Act or Public Procurement Act at the web page of Cooperation
Programme Interreg V-A – Estonia-Latvia under guiding documents:
Overview of the 2014-2020 Structural Assistance Act Chapter 4 Implementation of ETC programme:
§ 52. Drawing up and approval of programme and allocation of financial resources – defines
competencies of the Estonian Ministry of Finance, Minister of Public Affairs and of the Government of the
Republic of Estonia, when setting up the programme and allocating financial resources to the ETC
programmes. This paragraph is insignificant for the target groups of Estonia - Latvia programme, as it is
irrelevant, as regards the application for and implementation of projects.
§ 53. Compliance with functions of managing authority, certification authority, secretariat, auditing
authority and member state – defines competencies of the Ministry of Finance, when performing the
functions of a member state, appointing an organization responsible for performing the functions of MA;
CA, JS, FC and the AA, including the establishment of information or contact points by the MA, and
nomination to the MC and GoA. This paragraph is insignificant for the target groups of Estonia - Latvia
programme, as it is irrelevant, as regards the application for and implementation of projects.
§ 54. Eligibility of costs, verification thereof and conduct of financial correction. As MC of the programme
or has established the conditions and procedure for determination of the eligibility of costs for the
purposes of Article 18 (3) of Regulation (EU) No 1299/2013 of the European Parliament and of the Council,
as well as the financial correction procedure, the paragraph is irrelevant for the target groups of Estonia -
Latvia programme. Information about the conditions and procedure for determination of the eligibility of
costs and financial corrections is described in the programme Manual and its annexes.
§ 541. Financial correction decision – defines the competencies of the MA, when making financial
correction decisions, and the content of and procedures for making financial correction decisions. As
regards Estonia - Latvia programme, Annex 6. Guidelines to Financial Corrections to the programme
Manual specifies programme procedures and describes the content of financial correction decisions,
based on this paragraph.
§ 55. Application for support, processing of application and obligations of applicant – obligations of the
applicants are described in the Programme Manual. Obligations of the ministries and other authorities are
not relevant for the applicants.
§ 56. Obligations of beneficiary and partner of ETC programme - obligations of the beneficiaries and
partners are described in the Programme Manual, its annexes, Grant Contract and Partnership Agreement.
§ 57. Obligations related to procurement – as the project partners are from Estonia and Latvia, and
national legislation defining procurement rules differs in Member States, there is a separate chapter
included to the programme Manual to describe the obligations of partners when carrying out purchases
and procurements.
§ 58. Rights of applicant and beneficiary – defined in programme level documents: Annex 4. Complaint
procedure of the programme Manual.
17
Audit of Management and Control Systems – Final Audit Report
§ 59. Processing of data related to provision of support – applies to programme authorities, is irrelevant
for target groups, as regards the application for and implementation of projects.
§ 60. Disclosure of data related to application for support and provision thereof – applies to programme
authorities.
§ 61. Failure to comply with obligation or claim and notification thereof – applies to programme
authorities.
The MA in cooperation with the JS has ensured that information about the regulations applicable to Estonian and
Latvian beneficiaries is available in the programme Manual. Lead partner of each project, when signing Subsidy
Contract, guarantees that the project is implemented and managed in accordance with all the relevant legal acts,
including the programme Manual.
As mentioned above, there is a chapter in the programme Manual about procurements in Estonia and Latvia:
chapter 5.5. “Price offers and procurement” with sub-chapter 5.5.1. “Price offers and public procurement in Latvia”
including references to national legal acts: Rules of the Cabinet of Ministers No. 104 of 28 February 2017, Public
Procurement Law and the Law on the Procurement of Public Service Providers of the Republic of Latvia; and sub-
chapter 5.5.2. “Price offers and public procurement in Estonia”, including references to Public Procurement Act of
the Republic of Estonia.
We have knowingly not added links to national level legal acts to the Manual and programme webpage, because
links may outdate, when acts are amended, and new versions enter into force. Instead, as we have appointed
specific programme consultants to each project, who consult the partners during implementation, this programme
consultant can support the project partner, when the partner is not capable of finding the legal act from the
Internet. The JS consultants encourage project partners to contact experts or hire a procurement expert to the
project team. As regards Estonian project partners, expertise of the team of procurement experts located in the
SSSC can be and has been used for checking the terms of references before the partner organisation launches the
procurement.
JS has regularly organized seminars to project partners in different topics related to project implementation,
reporting and procurements. Financial controllers and Audit Authority have been involved in these seminars to
introduce the legal framework and the practices to the target group.
FINAL COMMENT FROM THE AUDITOR:
1. Updating of the programme manual p. 5.5.2 in the light of court decisions 3-7-2718; C-155/19, C-156/19,
the auditors agree with the MA’s proposal regarding the period 2021+. Already during the project
application assessment phase it should be determined whether the beneficiary is a contracting authority
or not and it should be clearly communicated to the beneficiaries which procurement rules they should
apply.
This finding will be followed up by the AA when the period 2021+ programme manual has been drafted.
2. Regarding adding references to Structural Assistance Act or Public Procurement Act at the web page of
Cooperation Programme Interreg V-A – Estonia-Latvia under guiding documents, the auditors consider the
explanations and references provided by the MA in the audit report sufficient evidence that beneficiaries
are well informed about the relevant regulations. No follow-up is needed.
18
Audit of Management and Control Systems – Final Audit Report
Key requirement 4: Adequate management verifications (AC 4.2; AC 4.4)13
As a result of this audit, the auditors find that the MCS of the Programme on the Managing Authority’s procedures
on monitoring the tasks delegated to the Joint Secretariat regarded via the KR4 works, but some improvements are
needed (Category 2)
Finding No 4.1 – Procedures of on-the-spot verifications implemented by the JS should be
enhanced (significant)
The article 125 p. 5 (b) of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states
that the verifications include on-the-spot verifications of operations and may be carried out on a sample basis.
As the auditors assessed the procedures for on-the-spot verifications and discovered that the DMCS is a general
description of management and control systems that does not describe the actual procedures followed by the JS.
The detailed internal rules of procedure14 for on-the-spot verifications of the State Shared Service Centre are not
followed by the JS in case of Cooperation Programme Interreg V-A – Estonia-Latvia.
According to the DMCS p.2.1.3., the on-the-spot verifications are performed by the JS and the following aspects
are checked: whether the activities have been carried out as planned, whether the publicity requirements have been
followed. Verifications are not carried out on a sample basis. High-risk projects are checked at least once during
the project implementation.
Usually, the projects are visited twice (more, if necessary), and the focus is on the project and its activities as a
whole, not in visiting project partners separately. The JS almost never visits the offices of project partners,
because their intention is to visit the key activities of each project. All investment and construction activities are
monitored independently of other project activities, large investment objects and constructions are always visited
at least twice: before the activity has started and after completion of the activity.
When project consultant of the JS notices that there could be problems related to a project – e.g. on the basis of
project reports it is obvious that the project is making no progress, the implementation of activities includes
certain risks or the project would like to amend the application form multiple times, or there is a large number of
partners – the JS may participate in the meetings of the project.
The Head of the JS clarified the on-the-spot verification procedures followed by the JS:
The JS consultant participates at the project launch meeting (in case the information is provided to the JS
in due time), due to covid restrictions the consultants mostly participate online.
In the case of investments and construction projects the on-the-spot visits are carried out together with a
construction expert after the completion of the object. Harbours projects and Valga-Valka city centre are
checked 100%. Tourist sites and small-scale investment projects are checked randomly because these
investments are small-scale and often photo material is considered sufficient evidence.
Site visit form/checklist is used, including an assessment of the construction expert and follow-up
activities, if necessary. As a result of the system audit carried out in 2020, a question regarding the
fulfilment of the programme output indicators to the site visit form was added.
Intensity of on-the-spot verifications is assessed by the JS consultant based on the project action plan and
the performance of the partners. In case the project managers change frequently or there are irregularities
13
AC 4.2: on-the-spot verifications of individual operations may be carried out by the MA or JS on a sample basis. The records should
describe the sampling method used, identify the operations selected, and provide an overview of the conclusions of the verifications and the
detected irregularities.
AC 4.4: Evidence should be kept of:
a. the administrative verifications and the on-the-spot verifications, including the work done and the results obtained;
b. the follow-up of the findings detected.
These records constitute the supporting documentation and information for the annual summary to be prepared by the MA.
14
State Shared Service Centre work procedures for the period 2014-2020 p. 3.2.3.
19
Audit of Management and Control Systems – Final Audit Report
found regarding publicity and/or procurement rules, the consultant may carry out more on-the-spot visits
(especially if the project lasts 2-2.5 years), but definitely 1-2 on-the-spot visits are done during the project
implementation.
On-the-spot visits are planned according to the progress of projects in PlanPro. Progress of on-going
projects is monitored individually by the JS consultant.
As a result of the audit work performed the auditors conclude that the on-the-spot verification reports of
operations are attached to the progress reports in question in the eMS, but the eMS functionality does not allow to
get an overview of all on-the-spot checks performed.
Although during the current programme period, the JS has carried out 194 on-the-spot visits in case of 53 projects
from the total of 55 projects financed, there is a deviation from the principles set in the DMCS for on-the-spot
visits. Auditors note that in case of large investment and construction projects on-the-spot visits have not been
carried out before the activity has started. Sufficient clarification has been given during the audit by the Head of
the JS, but the auditors point out that the DMCS should be updated according to the actual procedures
implemented. Furthermore, it is not defined in the DMCS when operations financed are considered high-risk
projects.
Auditors note that in case of project Valga/Valka centre the on-the-spot visit was carried out in July, but the site
visit report was completed and entered in the eMS in October, there are no internal deadlines for completing the
on-the-spot reports and entering the results to the eMS set in the DMCS. Also two construction experts (Latvian
and Estonian construction expert) participated when on-the-spot visit of the project Valga/Valka centre was
performed, but the principles are not specified in the DMCS when external experts are involved and their role as
well as the results expected are not defined.
RISK: Auditors point out that there is a risk in not drafting adequate procedures and leaving the internal deadlines
clarified may affect the confidence in the description and function of the system. Current DMCS gives misleading
information about the nature of the on-the-spot verifications performed by the JS. Auditors point out that there is a
difference on how the on-the-spot verifications are described in the DMCS and how the JS carries them out in
practice.
RECOMMENDATION: Procedures are set in the DMCS in a very limited part to carry out on-the-spot verifications,
therefore procedures of on-the-spot verifications should be enhanced. Auditors recommend to draft and implement
detailed internal rules of procedure for carrying out on-the-spot verifications of operations15 and the DMCS should
be updated in more detail, including the clarifications given by the Head of the JS in the finding no 4.1. Also
aspects pointed out in the recommendation of finding no 1.2 should be considered when updating the procedures
for on-the-spot verifications. Furthermore, the auditors recommend to use the internal rules of procedure16 of the
State Shared Service Centre for on-the-spot verifications of operations in case of Cooperation Programme Interreg
V-A – Estonia-Latvia.
COMMENT FROM THE MA:
Procedures of on-the-spot verifications implemented by the JS should be enhanced
Procedures of on-the-spot verifications implemented by the JS in the DMCS are revised and updated, please see
Annex 3 with the new text for the DMCS.
FINAL COMMENT FROM THE AUDITOR:
The auditors have reviewed the MA’s proposals regarding updated description of on-the-spot visits by the JS for
the DMCS in Annex 3 to the audit report, but would like to point out that from the presented description following
15
Verifications are undertaken on the project's physical progress, delivery of the products, services and works, publicity rules, accounting
system, and related documentation.
16
State Shared Service Centre work procedures for the period 2014-2020 p. 3.2.3.
20
Audit of Management and Control Systems – Final Audit Report
information is missing:
• principles of online verifications for on-the-spot checks during pandemic times;
• the sample size and sample composing principles in case on-the-spot visits are carried out based on sample size;
• description where the on-the-spot verification reports can be found - the on-the-spot verification reports of
operations are attached to the progress reports in question in the eMS.
Auditors do not agree with the following description in the procedures of on-the-spot verifications implemented by
the JS in Annex 3 to the audit report: “The JS does not perform site visits to the investments that are already
verified by the FCs” as the scope of the verifications performed by the FC and the JS might be different. Therefore,
no projects should be excluded from the possibility of being verified by the JS.
This finding will be followed up by the AA when the DMCS is updated.
Key requirement 8: Appropriate procedures for drawing up the management declaration and
annual summary of the final audit reports and of controls carried out
As a result of this audit, the auditors find that the MCS of the Programme of the MA’s procedures on drawing up
the annual summary and management declaration regarded via the KR8 works partially; substantial improvements
are needed (Category 3)
Finding No 8.1 – The MA has not set appropriate procedures for drawing up the management
declaration and annual summary. There is no audit trail of the performance analysis carried out
and conclusions made for drawing up the annual summary and the management declaration
(significant)
The article 125 p.4 (e) of the Regulation (EU) No 1303/2013 of the European Parliament and of the Council states
that as regards the financial management and control of the operational programme, the MA shall draw up the
management declaration and annual summary.
As the auditors assessed the procedures for drawing up the management declaration and annual summary and
discovered the following:
DMCS is a general description of management and control systems that does not describe the actual
procedures followed by the MA when drawing up annual summary and management declaration, e.g. it is
not specified how the follow-up of the irregularities of management verifications and audit results is done.
Detailed internal rules of procedure of the State Shared Service Centre17 are not followed by the MA in
case of Cooperation Programme Interreg V-A – Estonia-Latvia.
There are no adequate internal deadlines set for drawing up annual summary and the management
declaration, including when the annual summary and management declaration are submitted to the AA for
assessment.
There is no audit trail of the work carried out in preparation of the annual summary and the management
declaration by the JS and the MA. As the MA does not carry out performance analysis or equivalent
analysis of the programme referred in the finding no 1.1, relevant input is missing for drawing up annual
summary and management declaration.
The MA has not indicated in the annual summary what conclusions it has drawn from the management
verifications and audits and controls and any corrective measures that it has adopted regarding
improvement in the functioning of the MCS, including instructions, guidance and training planned or
provided to beneficiaries to prevent repetition of the same errors in future operations.
17
State Shared Service Centre work procedures for the period 2014-2020 p. 2.2.3.
21
Audit of Management and Control Systems – Final Audit Report
RISK: Auditors point out that there is a risk in leaving the internal deadlines clarified and not providing audit trail of
the work carried out in preparation of the annual summary and the management declaration may affect the
confidence in the description and function of the system.
RECOMMENDATION:
1. Auditors recommend to implement detailed internal rules of procedure for monitoring the tasks delegated to the
JS and the DMCS should be updated in more detail. Following aspects should be considered:
Detailed procedures for drawing up the management declaration and annual summary should be drafted
that describe the actual procedures followed by the MA, including appropriate follow-up of the
irregularities of management verifications and audit results;
Clear responsibilities to the staff of the JS and the MA are assigned to ensure that all the data needed to
prepare the annual summary and management declaration is obtained;
Adequate internal deadlines should be set for drawing up the annual summary and management
declaration.
Auditors recommend to use the internal rules of procedure18 of the State Shared Service Centre for drawing up
the management declaration and annual summary.
2. In the annual summary following aspects should be included19:
Information on all administrative and on-the spot controls carried out and an assessment of their results
and impact on the MCS and legality and regularity of the expenditure entered in the accounts.
Confirmation by the MA of the effective and compliant functioning of the MCS in relation to a number of
key elements: appropriate treatment in the accounts of irregularities detected, including in the case of an
on-going assessment of the legality and regularity of expenditure; data related to indicators, milestones
and progress of the programme.
Conclusions the MA has drawn from the management verifications and audits and controls and the
corrective measures that it has adopted regarding any improvement in the functioning of the MCS,
including instructions, guidance and training planned or provided to beneficiaries to prevent repetition of
the same errors in future operations.
In case the MA decides not to repeat information already provided by the AA in the annual control report
(hereinafter ACR), then appropriate cross-references to the relevant sections of the ACR should be
included in the annual summary.
Programme performance analysis should be carried out by the MA and its results should be taken into account
when compiling the annual summary and management declaration.
Adequate audit trail of the work carried out in preparation of the annual summary and the management declaration
by the JS and the MA should be kept.
COMMENT FROM THE MA:
Appropriate procedures for drawing up the management declaration and annual summary
The DMCS includes the description of the procedures carried out by the MA for the preparation of the Management
Declaration and the Annual Summary, with references to the model set out in Annex VI to the Commission
Implementing Regulation (EU) 2015/207, to Annex 1 of the “Guidance for Member States on the Drawing of
18
State Shared Service Centre work procedures for the period 2014-2020 p. 2.2.3.
19
Guidance for Member States on the Drawing of Management Declaration and Annual Summary (EGESIF_15-008; 03/12/2018)
https://ec.europa.eu/regional_policy/sources/docgener/informat/2014/guidance_management_declaration_annual_summary_en.pdf.
22
Audit of Management and Control Systems – Final Audit Report
Management Declaration and Annual Summary Programming period 2014-2020 Revision 2018” and “Guidance on
amounts withdrawn, recovered, to be recovered and irrecoverable amounts”.
MA follows the format and guidelines provided by the European Commission, to ensure that all the necessary data
is included in the Annual Summary, so far the European Commission has approved these documents without any
additional questions or comments about lack of data.
As regards the different aspects, annual summary should include:
Information on all administrative and on-the spot controls carried out and an assessment of their results
and impact on the MCS and legality and regularity of the expenditure entered in the accounts. MA
comment: The information is provided by JS and FCs, who carry out on the spot checks. As described
above, MA will use performance analysis for the task.
Confirmation by the MA of the effective and compliant functioning of the MCS in relation to a number of
key elements: appropriate treatment in the accounts of irregularities detected, including in the case of an
on-going assessment of the legality and regularity of expenditure; data related to indicators, milestones
and progress of the programme. MA comment: This can be included, and as described above, MA will use
performance analysis for the task.
Conclusions the MA has drawn from the management verifications and audits and controls and the
corrective measures that it has adopted regarding any improvement in the functioning of the MCS,
including instructions, guidance and training planned or provided to beneficiaries to prevent repetition of
the same errors in future operations. MA comment: Partly this is also provided by JS and FCs, but MA can
add and consolidate the information.
In case the MA decides not to repeat information already provided by the AA in the annual control report
(hereinafter ACR), then appropriate cross-references to the relevant sections of the ACR should be
included in the annual summary. MA comment: References to audit reports are given in the part A, which
is usually filled in by AA and in Annual Accounts Appendix 8. There is no need to repeat them in the Annual
Summary text.
MA prefers to keep the flexibility to agree each year separately the internal deadlines during the programme
authorities’ meetings or separately with different programme authorities, because the teams of the programme
authorities are small and workloads may be periodically high, flexibility in deadlines and timing is necessary to
make sure that the workloads of staff members are respected, tasks are carried out in time and there is adequate
time allowed for all stages.
MA reviews and updates the deadlines of the procedures in the DMCS accordingly:
The template of the Annual Summary is sent to the programme authorities for fulfilment of their part by the
end of 2nd week of December at the latest. The programme authorities involved are: Audit Authority, Joint
Secretariat, FCs of Estonia and Latvia.
The Annual Summary is filled in according to the instructions given in the beginning of each section (A, B, C).
The Programme authorities are expected to give their feedback to the template of the Annual Summary in
three weeks from sending the template to programme authorities. In case of errors detected and corrective
actions taken, the JS and FCs always include relevant information. The MA examines this information and in
case considers it necessary inquires more on the identified issues.
The MA consolidates the input into one document and submits it together with the Management Declaration
and Annual Accounts to the MC for approval via a shortened written procedure on 31 January at the latest, to
ensure that even in case of additional questions and comments MA manages to submit the documents in time
to the European Commission.
The whole package has to be submitted to the European Commission by 15 February. The Annual Summary is
the last document to be submitted after the AA has approved and uploaded the Annual Accounts and
Management Declaration to the SFC. MA proposal for deadline for MA and AA, as regards inserting of data and
documents in SFC: February 14 or one but last working day before February 15.
23
Audit of Management and Control Systems – Final Audit Report
MA uses the performance analysis data as basis, when preparing the Management Declaration and Annual
Summary, as described above. In parallel, as additional data is gathered from programme authorities and eMS
information system, to update the performance analysis and action plan by 31 January.
Audit trail consists of exchange of e-mails; all contributions, written procedures etc that are related to Annual
Summaries are stored in the network drive of SSSC by MA; data in the SFC, inserted by MA and CA, and in eMS.
Follow-up activities are carried out in accordance with the DMCS, programme Manual and its Annex 6. Guidelines
to Financial Corrections, and action plan of the performance analysis.
FINAL COMMENT FROM THE AUDITOR:
Auditors do not agree with the description of the procedures regarding drafting the Annual Summary provided by
the MA above:
• “The template of the Annual Summary is sent to the programme authorities for fulfilment of their part by the end
of 2nd week of December at the latest.”
•”The Annual Summary is filled in according to the instructions given in the beginning of each section (A, B, C). The
Programme authorities are expected to give their feedback to the template of the Annual Summary in three weeks
from sending the template to programme authorities.”
Auditors point out that it is the responsibility of the MA to draft the Annual Summary, including draw conclusions
from the audit reports. AA should not fill the Annual Summary template on behalf of the MA as the AA has the
obligation to audit the Annual Summary, therefore it is essential to ensure the independence of the AA.
From the comments provided by the MA above it is not clear how the tasks are divided between the staff of the JS
and the MA to ensure that all the data needed to prepare the Annual Summary and Management Declaration is
obtained.
Auditors point out that adequate internal deadlines should be set for drawing up the annual summary and
management declaration, for example when the Annual Summary and Management Declaration is submitted to the
AA for assessment.
Although the MA has followed the template of the Annual Summary, the information described above in the
recommendation is missing from the Annual Summary drafted in February 2021. Therefore, auditors encourage
the MA to include the following aspects to the Annual Summary drafted in February 2022:
• an assessment and conclusions drawn of administrative and on-the spot controls carried out by the JS
and the FC, including impact on the MCS and legality and regularity of the expenditure entered in the accounts.
• confirmation by the MA of the effective and compliant functioning of the MCS in relation to a number of
key elements: appropriate treatment in the accounts of irregularities detected, including in the case of an on-going
assessment of the legality and regularity of expenditure; data related to indicators, milestones and progress of the
programme.
• conclusions the MA has drawn from the management verifications and audits and controls and the
corrective measures that it has adopted regarding any improvement in the functioning of the MCS, including
instructions, guidance and training planned or provided to beneficiaries to prevent repetition of the same errors in
future operations.
This finding will be followed up by the AA when the DMCS is updated, performance analysis has been performed
and the Annual Summary drafted in February 2022 by the MA.
24
Audit of Management and Control Systems – Final Audit Report
ANNEX 1 – Summary opinion of the auditee’s MCS
Key requirement20 Category 1 Category 2 Category 3 Category 4
Key requirement 1: Adequate separation of
functions and adequate systems for reporting
and monitoring where the responsible X
authority entrusts execution of tasks to
another body
Key requirement 3: Adequate information to
X
beneficiaries
Key requirement 4: Adequate management
X
verifications
Key requirement 8: Appropriate procedures for
drawing up the management declaration and
X
annual summary of the final audit reports and
of controls carried out
Summary opinion of the auditee’s MCS 21 X
20
Guidance for the Commission and Member States on a common methodology for the assessment of management and control systems in the Member
States EGESIF_14-0010-final 18/12/2014
https://ec.europa.eu/regional_policy/sources/docgener/informat/2014/guidance_common_mcs_assessment_en.pdf
p. 2.2.3 Conclusion by authority
2. Some key requirements are essential with regard to the legality and regularity of expenditure and the proper functioning of the relevant authority. Criteria for
determining serious deficiencies as defined in Article 2(39) CPR are set out in Article 30 CDR and concern: MA: key requirements 2 (selection of operations), 4
(management verifications) and 5 (audit trail of documents regarding expenditure and audits).
3. A category 1 or 2 classification of the seven essential key requirements referred to in point 2 above would have a positive influence on the overall
conclusion.
4. If one of the essential key requirements referred to in point 2 above or two or more of the other key requirements for an authority are classified in
categories 3 or 4, this authority cannot be assessed overall in a better category than category 3 or 4. In other words, deficiency in an essential key requirement
cannot be counterbalanced by a better classification of the other key requirements for the authority in question.
21
According to the Guidance for the Commission and Member States on a common methodology for the assessment of management and control systems in
the Member States EGESIF_14-0010-final 18/12/2014
https://ec.europa.eu/regional_policy/sources/docgener/informat/2014/guidance_common_mcs_assessment_en.pdf
p. 2.2.3 subsections 2 and 4 the overall conclusion by the AA is category 2 as the KR8 referred above in the Guidance p.2.2.3 section 2 is not an essential KR.
25
Audit of Management and Control Systems – Final Audit Report
ANNEX 2 – Tasks divided between the MA, JS and FCs in DMCS table 1
Responsible
for carrying
Task Reference out the task
MA JS FC
Monitoring Committee
Supporting the work of the MC, providing it with the information it requires Article 125 of the X x
to carry out its tasks, in particular data related to the progress of the Regulation (EU)
operational programme in achieving its objectives, financial data and data 1303/2013
related to indicators and milestones.
Electronic monitoring system
Establishing a system to record and store in computerised form data on Articles 125-126 of x X
each operation necessary for monitoring, evaluation, financial the Regulation
management, verification and audit, including data on individual (EU) 1303/2013
participants in projects, where applicable. Ensuring that the data is
collected, entered and stored in the system. Ensuring that the system
stores data on accounting records for each projects and all the data
required for drawing up payment applications and accounts, including
records of amounts recoverable, amounts recovered and amounts
withdrawn following cancellation of all or part of the contribution for a
project of the programme; accounting records of expenditure declared to
the Commission and of the corresponding public contribution paid to
project partners etc.
Information and communication
Drawing up, implementing and amending communication strategy of the Articles 115-117 of x X
programme. the Regulation
(EU) 1303/2013
Providing access via the programme website to relevant information about Article 115 of the X
the programme implementation, including a list of funded projects, and to Regulation (EU)
the eMS. 1303/2013
Designating one person to be responsible for information and Article 117 of the x X
communication at operational programme level and informing the Regulation (EU)
Commission of the designated person. 1303/2013
Ensuring availability of the information that is relevant to the JS for Article 125 of the X
execution of their tasks and the implementation of the programme and Regulation (EU)
projects according to the programme rules and respective legal acts. 1303/2013
Ensuring availability of the information that is relevant to project partners x X
and applicants, for ensuring the application and implementation of projects
according to the programme rules and respective legal acts.
Selection of operations
Drawing up and, after MC approval, implementing appropriate project Article 125 of the x X
selection procedures and criteria. Regulation (EU)
Signing Subsidy Contracts to ensure that the beneficiary is provided with a 1303/2013 X x
document setting out the conditions for support, including specific
requirements concerning the products or services to be delivered, financing
plan, and time-limit for implementation of the project.
Determining the categories of intervention, as well as respective state aid x X
or de minimis aid types.
Decision on specific issues related to eligibility of operations – when an Article 70 of the X x
operation is implemented outside the programme area but within the Regulation (EU)
Union. 1303/2013
26
Audit of Management and Control Systems – Final Audit Report
Financial management and control of the operational programme
Managing the operational programme in accordance with the principle of Article 125 of the X x x
sound financial management. Regulation (EU)
1303/2013
Checking through reports that project partners maintain either a separate x X
accounting system or an adequate accounting code for all transactions
related to an operation.
Identifying the risks related to programme implementation and putting in X x x
place effective and proportionate anti-fraud measures.
Setting up procedures to ensure that all documents regarding expenditure X
and audits required to ensure an adequate audit trail are held in
accordance with the requirements of point (g) of Article 72 of the
Regulation (EU) 1303/2013.
Establishing a method for revenue generation, determining net revenue Article 61 of the X X x
and deducting net revenue. Regulation (EU)
1303/2013
Ensuring, for the purposes of drawing up and submitting payment Article 126 of the X x x
applications, that the MA has received adequate information on the Regulation (EU)
procedures and verifications carried out in relation to expenditure. 1303/2013
Making financial correction decision, keeping an account of amounts X
recoverable and of amounts withdrawn following cancellation of all or part
of the contribution for an operation.
Reporting
Drawing up the management declaration, annual summary and accounts, Article 125 of the X X
as referred in points (a) and (b) of Article 59(5) of the Regulation (EU, Regulation (EU)
EURATOM) No 966/201222 and, compiling and after MC approval, 1303/2013
submission of the annual and final implementation reports to the
Commission.
Drawing up and submitting payment applications to the Commission, and Article 126 of the X x
certifying that they result from reliable accounting systems, are based on Regulation (EU)
verifiable supporting documents and have been subject to verifications; 1303/2013
certifying the completeness, accuracy and veracity of the accounts and that
the expenditure entered in the accounts complies with applicable law and
has been incurred in respect of operations selected for funding in
accordance with the criteria applicable to the operational programme and
complying with applicable law.
Notifying the MoF and Member States about the irregularities, deductions, X x x
recovered and non-recoverable amounts.
By 31 January, 31 July and 31 October, submitting to the Commission data Articles 50(2) and X x
on total and public eligible cost of the operations and the number of 112 of the
operations selected for support and the total eligible expenditure declared Regulation (EU)
by beneficiaries to the MA. The transmission by 31 January contains the 1303/2013
above data broken down by categories of intervention. The transmissions
by 31 January and 31 July include forecasts of the amounts for which
Member States expect to submit payment applications for the current and
the subsequent financial year.
Evaluation of the programme
Drawing up (and amending, if necessary) an evaluation plan of the Article 56 of the X x
programme and submission of the evaluation plan to the MC no later than Regulation (EU)
one year after the adoption of the co-operation programme. 1303/2013
22
Regulation (EU, EURATOM) No 966/2012 of the European Parliament and of the Council of 25 October 2012 on the financial rules
applicable to the general budget of the Union and repealing Council Regulation (EC, Euratom) No 1605/2002, link to the Regulation:
http://eur-lex.europa.eu/legal-content/EN/ALL/?uri=CELEX:32012R0966
27
Audit of Management and Control Systems – Final Audit Report
Submitting a report summarising the findings of evaluations carried out Article 114 of the X x
during the programme to the Commission by 31 December 2022. Regulation (EU)
1303/2013
Financial control
Verification that the co-financed products and services have been delivered Article 125 of the X
and that expenditure declared by the beneficiaries has been paid and that it Regulation (EU)
complies with applicable law, the operational programme and the 1303/2013
conditions for support of the operation.
Administrative verifications in respect of each application for x X
reimbursement by beneficiaries.
On-the-spot verifications of operations. X X X
28
Audit of Management and Control Systems – Final Audit Report
Annex 3 – Description of on-the-spot verification by the JS
The JS carries out the on-the-spot verification of the activities of the approved projects. The responsible
programme consultant visits every project at least twice during the project: in the beginning to assist the correct
kick-off of the project, and during the project implementation. In case severe deviations are identified, also the
related costs may be declared ineligible by the JS. More specifically, the JS checks:
1. If the activities are in line with the application.
2. If the investments are implemented in line with the application and building documentation as
relevant.
3. If there are any signs of possibly problematic aspects, which might have negative impact on
project implementation.
4. If the publicity rules are followed.
5. If the fulfilment of the output indicators is ensured.
As a rule, the consultants perform the site visits to the joint activities, e.g. conferences, seminars or other public
events, not to the individual partners. Depending on the type of the project and partnership (e.g. SME cooperation
projects with no public events and rare in-person events), the project activities can be attended and visit conducted
online. In case of the investment objects, the site visits can be performed separately from the events. The large
investment objects and constructions are always visited at least twice: before the activity has started and after
completion of the activity.
The consultant decides if there is a need to involve the SSSC (EE) or outsourced (LV) construction expert for the
particular site visit. The function of the construction expert is to check if the investments are implemented
according to the national legislation, all documentation is correct, and the object(s) correspond to the building
documentation approved by the programme. In case of big partnership and many investment sites, objects and
equipment, the consultant performs the on-the-spot verification based on the sample. The JS does not perform
site visits to the investments that are already verified by the FCs.
The responsible consultant can perform more site visits to the project based on the general performance of the
Lead partner and partnership, complexity of the project, size of the partnership or other considerations related to
the risk on the achievement of the project results.
Due to the cross-border nature and large partnerships the organisations need regular JS guidance and advice.
Thus, the additional purpose of the site visits is to provide support and help in implementation and understanding
the rules. Therefore, the site visits are always agreed beforehand with the representatives of the organisation that
is most relevant for the event/investment to be checked.
The consultant fills in the site visit form that will be signed by the consultant, project representatives, construction
expert(s) and the Head of the JS during two weeks after the visit.
29
Pr Ege Ello
Riigi Tugiteenuste Keskus Meie 23.12.2021 nr 10-5/9280-1
[email protected]
Süsteemiauditi aruande edastamine
Austatud proua Ello
Edastame Teile „Cooperation Programme Interreg V-A – Estonia-Latvia“ juhtimis- ja
kontrollsüsteemi auditi lõpparuande nr JKS-40/2020.
Täname Teid meeldiva koostöö ja abi eest auditi läbiviimisel.
Lugupidamisega
(allkirjastatud digitaalselt)
Kaur Siruli
Finantskontrolli osakonna juhataja
Auditeeriva asutuse juht
Lisa: Auditi lõpparuanne 29 leheküljel
Sama:
Pr Helena Järviste, Riigi Tugiteenuste Keskus (
[email protected])
Hr Martin Karro, Riigi Tugiteenuste Keskus (
[email protected])
Hr Urmo Merila, Riigi Tugiteenuste Keskus (
[email protected])
Pr Karin Viikmaa, Riigi Tugiteenuste Keskus (
[email protected])
Elis Kõrvek 611 3197
[email protected]
Suur-Ameerika 1 / 10122 Tallinn / 611 3558 /
[email protected] / www.rahandusministeerium.ee
registrikood 70000272