Estonian EU External Border Programme
(Estonia-Russia CBC Programme 2014-2020)
Audit of the practice and reliability of the
Programme output indicators
Audit No JKS-48/2021
Final Report
28.02.2023
Prepared by the Audit Authority
Audit of management and control system – Final Report
Audit final report recipients:
Ms. Ege Ello, Head of the Managing Authority
Ms. Unda Ozolina, Head of the Joint Technical Secretariat
EXECUTIVE SUMMARY
The purpose of this audit was to assess the effectiveness of the management and control system of Estonian EU
External Border Programme (Estonia-Russia CBC Programme 2014-2020) concerning the practice and reliability of
the Programme output indicators.
The assessment was carried out based on the following:
• Key requirement 1: Adequate separation of functions and adequate systems for reporting and monitoring
where the responsible authority entrusts execution of tasks to another body.
• Key requirement 3: Adequate information to beneficiaries.
• Key requirement 4: Adequate management verifications.
• Key requirement 5: Effective system in place to ensure that all documents regarding expenditure and audits
are held to ensure an adequate audit trail.
• Key requirement 6: Reliable system for collecting, recording, and storing data for monitoring, evaluation,
financial management, verification, and audit purposes, including links with electronic data exchange
systems with beneficiaries.
• Key requirement 8: Appropriate procedures for drawing up the management declaration and annual
summary of final audit reports and of controls carried out.
By compiling the audit opinion, the auditors considered the evidence gathered and conclusions made during the
audit work.
SUMMARY OF THE AUDIT RESULTS
As the result of this audit, the Audit Authority is in opinion that the management and control system of the
Estonian EU External Border Programme (Estonia-Russia CBC Programme 2014-2020) in respect of the Key
requirements 1, 3, 4, 5, 6 and 8 works, but some improvements are needed (Category 21).
The detailed results by assessment criteria are presented in Part B of this report and the summary table of
results in Annex 1.
During the audit, the following significant2 findings were made:
Finding No 3.1 - The communication to beneficiaries by the Joint Technical Secretariat concerning the details
of indicator data as well as counting and reporting of indicators should be strengthened (significant)
Finding No 4.1 - The checklist used for management verifications of progress reports should be improved in
some respects (significant)
1 Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
2 Significant findings are findings that describe an error in the auditee’s management and control system which has a significant effect on the
possibility of fulfilling its critical tasks and requirements (this may include systemic errors). Significant findings require immediate action from
the auditee’s management to correct those errors.
Non-significant findings are findings that describe an error in the auditee’s management and control system which has a non-significant effect
on the possibility of fulfilling its critical tasks and requirements (this may include random errors). Non-significant findings require action from
the auditee’s management to correct those errors.
2
Audit of management and control system – Final Report
Finding No 5.1 - The requirements concerning clarity and ease of understanding of the information presented
by the beneficiaries should be updated and uniformly enforced (significant)
The auditors assume that the information presented to them during the audit including both in written and verbal
form describe the management and control system correctly and in accordance with its actuality. Should there exist
information that was not known or not presented to the auditors at the time, the results and the opinion may have
been different.
The audit has been carried out in accordance with internationally accepted internal auditing standards of the IIA –
International Standards for the Professional Practice of Internal Auditing.
The final audit report will be published at the homepage of the Ministry of Finance of the Republic of Estonia.
The audit team wishes to thank the employees of the Estonian EU External Border Programme (Estonia-Russia CBC
Programme 2014-2020) for their cooperation and assistance during the audit work.
Preliminary Report consists of 14 pages and an annex.
Audit supervisor: Audit manager:
(Signed electronically) (Signed electronically)
Kaur Siruli Mart Pechter
Head of Financial Control Department Advisor of Financial Control Department
3
Audit of management and control system – Final Report
TABLE OF CONTENTS
EXECUTIVE SUMMARY .......................................................................................................................................... 2
TABLE OF CONTENTS ............................................................................................................................................ 4
PART A .................................................................................................................................................................. 5
1. SUMMARY OF THE AUDIT WORK ................................................................................................................ 5
2. SAMPLING METHODOLOGY ...................................................................................................................... 5
3. BACKGROUND INFORMATION.................................................................................................................... 6
4. FOLLOW-UP AND MONITORING ................................................................................................................. 7
PART B .................................................................................................................................................................. 8
FINDINGS AND RECOMMENDATIONS ..................................................................................................... 8
Finding No 1.1 - The tasks of the Managing Authority and Joint Technical Secretariat concerning indicators of
the programme should be clarified in the Description of management and control system (non-significant) ....... 8
Finding No 3.1 - The communication to beneficiaries by the Joint Technical Secretariat concerning the details of
indicator data as well as counting and reporting of indicators should be strengthened (significant) .................... 9
Finding No 4.1 - The checklist used for management verifications of progress reports should be improved in
some respects (significant) ................................................................................................................................. 11
Finding No 5.1 - The requirements concerning clarity and ease of understanding of the information presented by
the beneficiaries should be updated and uniformly enforced (significant) .......................................................... 12
Finding No 8.1 - There should be some random checks on the indicator data as presented for the annual
reporting (non-significant) ................................................................................................................................... 13
ANNEX 1 – SUMMARY OPINION OF THE AUDITEE’S MANAGEMENT AND CONTROL SYSTEM ...................................... 15
4
Audit of management and control system – Final Report
PART A
1. Summary of the audit work
In accordance with the “Agreement on financing and implementation of Cross-Border Cooperation Programme
Estonia-Russia 2014-2020” and the working plan of the Audit Authority for the years 2021-2022, the Audit Authority
carried out an audit on the management and control system of Estonian EU External Border Programme (Estonia-
Russia CBC Programme 2014-2020) concerning the practice and reliability of the Programme output indicators. The
purpose of the audit was to give an independent opinion on the functioning and effectiveness of the management
and control system in that regard.
The audit was carried out between 16/09/2021 and 28/02/2023. The audit was managed, and the audit procedures
carried out by an Advisor of the Financial Control Department of the Ministry of Finance of Estonia, Mart Pechter.
The audit supervisor was the Head of the Financial Control Department, Kaur Siruli.
To present an opinion, the management and control system with regards to the practice and reliability of the
Programme output indicators was analyzed and tested in accordance with the Key requirements 1, 3, 4, 5, 6 and 8.
The audit was based on the following documents:
- Joint Operational Programme document of Estonia-Russia Programme.
- Description of the management and control system of the Estonia-Russia Programme.
- Methodologies and specific documents related to those documents developed and used by the Joint Technical
Secretariat, such as the forms, checklists, and guiding materials.
- Selected indicators from progress report forms and the checklists and decisions pertaining to those forms.
To form an opinion, the following audit procedures were carried out:
- The evaluation of compliance of the practice and reliability of the Programme output indicators set out in the
documents in comparison with the Key requirements 1, 3, 4, 5, 6 and 8.
- Testing in the practice of the Programme in the practice and reliability of the Programme output indicators by
selecting several indicators from progress report forms and checking the checklists and decisions for
observation of the practice.
- Conducting interviews with the Head of the Joint Technical Secretariat, among others.
The audit work was based on the methodology developed by the Financial Control Department for the period of 2014-
2020.
2. Sampling methodology
To test for the practice, all indicators were selected for testing.
More specifically, the testing objects were selected as follows:
- In step one, all indicators of the Programme were selected for testing.
- In step two, two indicators were removed from the population. Those indicators were the following:
o “Number of border crossing points with increased throughput capacity”.
o “Increased throughput capacity of trucks on land border crossing points”.
The reason for their removal was that the respective indicators had become obsolete. Those indicators had also
been removed from the Joint Operational Programme by the decision of the Joint Monitoring Committee.
5
Audit of management and control system – Final Report
- In step three, all other indicators were selected for testing. Those indicators were the following:
o “Additional waste recycling capacity”.
o “Members of the population who benefit from forest fire protection measures”.
o “Number of enterprises that are substantially and actively involved in the projects as final beneficiaries”.
o “Number of improved cultural and historical sites as a direct consequence of programme support”.
o “Number of organizations using programme support for cooperation in education, R&D, and innovation”.
o “Number of organizations using programme support for promoting local culture and preserving
historical heritage”.
o “The number of participants at events that are aimed at vocational and language training”.
o “The number of participating organizations cooperating across borders for improved governance”.
o “The number of persons actively participating in environmental actions and awareness raising
activities”.
o “The number of projects that are related to the purification of common water assets”.
- Those indicators were tested in two ways. First, data was used from the audits of operations carried out so far
on the following projects:
o ER80 “ESTRUSEEL”.
o ER90 “HAZLESS”.
o ER2 “Common Peipsi 2”.
o ER126 “LOCAL FIRE”.
o ER48 “Via Hanseatica Plus”.
o ER15 “SaveSmart”.
o ER30 “BioStyrene”.
- Second, additional projects were selected for testing:
o ER13 “Approach2Waste”.
o ER4 “River Promenades III”.
o ER96 “Connecting Through Music”.
o ER78 “HEALTHY”.
o ER89 “NTIT”.
o ER8 ”CuNaHe”.
This selection covered all the indicators, with at least one and up to three projects selected for each indicator.
The auditor considers this sample to be sufficient for the purposes of this audit.
3. Background information
In accordance with “Agreement on financing and implementation of Cross-Border Cooperation Programme Estonia-
Russia 2014-2020”, the Audit Authority ensures that audits are carried out on the management and control system
of the Estonian EU External Border Programme (Estonia-Russia CBC Programme 2014-2020).
6
Audit of management and control system – Final Report
The audit of the concerning the practice and reliability of the Programme output indicators was added to the working
plan of the Audit Authority because as per the risk assessment, the audits of operations indicated that there may be
issues with that area of the Programme.
4. Follow-up and monitoring
The auditee must take into consideration all the findings and recommendations presented in the Part B of this report.
The Managing Authority is responsible for the follow-up and monitoring of the implementation of measures taken as
a result and will report of the results in a written form. The final opinion on the implementation of measures will be
given by the Audit Authority. If necessary, a follow-up audit may be conducted.
7
Audit of management and control system – Final Report
PART B
FINDINGS AND RECOMMENDATIONS3
Key requirement 1: Adequate separation of functions and adequate systems for reporting and
monitoring where the responsible authority entrusts execution of tasks to another body
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 1 works well. Only minor improvements needed
(Category 1) 4
Finding No 1.1 - The tasks of the Managing Authority and Joint Technical Secretariat concerning
indicators of the programme should be clarified in the Description of management and control
system (non-significant)
In accordance with the article 24 p. 1 of the Commission Implementing Regulation (EU) No 897/2014, the Joint
Monitoring Committee shall follow the programme implementation and progress towards its priorities using the
objectively verifiable indicators. The Managing Authority, in accordance with the article 26 p. 2 (a) of the same
Regulation, supports the work of the Joint Monitoring Committee and provides it with the information it requires to
carry out its tasks. That is also how the tasks are set out in the Description of management and control system of
the Estonian EU external border programme (Estonia-Russia CBC programme 2014-2020).
However, the auditor notes that the management of indicators, concerning the statement of roles in checking the
quality of the information and compiling the results, is currently not stated clearly enough in the Description of
management and control system. The auditor points out that in practice, the information concerning indicators is
managed by and presented from the Joint Technical Secretariat to the Managing Authority and only then used by
the Managing Authority to support the work of the Joint Monitoring Committee
RISK: The correct management of indicators is an important part of understanding the progress of the programme.
If the indicator management, including checks, compilation and presentation is not clearly assigned in the
Description of management and control system, the responsibility for that management may be weakened for the
lack of clarity.
RECOMMENDATION No 1.1 TO THE MANAGING AUTHORITY: The auditor recommends the Managing Authority to
update the Description of management and control system to clarify that the Managing Authority is responsible for
the data on indicators as presented to the Joint Monitoring Committee. In addition to that, it should be clarified that
the Joint Technical Secretariat is responsible for the management, including checks on the data on indicators and
the information on them as compiled and presented to the Managing Authority.
COMMENT FROM THE MANAGING AUTHORITY
Managing Authority agrees with the recommendation to update the procedures in the Description of management
and control systems to clarify the actual division of tasks and responsibilities between Managing Authority and Joint
Technical Secretariat in the 1st half of 2023.
FINAL COMMENT FROM THE AUDITOR
3 Audit findings are listed according to the assessment criteria of the management and control system assessment methodology
4 Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
8
Audit of management and control system – Final Report
The auditor agrees with the follow-up actions proposed by the Managing Authority and considers the finding closed.
Key requirement 3: Adequate information to beneficiaries
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 3 works, but some improvements are needed
(Category 2) 5
Finding No 3.1 - The communication to beneficiaries by the Joint Technical Secretariat concerning
the details of indicator data as well as counting and reporting of indicators should be strengthened
(significant)
In accordance with article 26 p. 2 (c) of the Commission Implementing Regulation (EU) No 897/2014, the Managing
Authority shall make available to intermediate bodies and beneficiaries’ information that is relevant to the execution
of their tasks and the implementation of operations respectively. That is also how the tasks are set out in the
Description of management and control system of the Estonian EU external border programme (Estonia-Russia CBC
programme 2014-2020).
When considering the nature of the indicators and how they may be counted, the programme uses the Interact-
developed list of Common Output Indicators for ENI CBC 2014-2020 as well as the list of Output and Result Indicators
developed as a part of the Joint Operational Programme. Also, the Joint Technical Secretariat provides consultation
to the beneficiaries related to the indicators during the application, implementation, and reporting process.
However, the auditor notes that the Managing Authority and the Joint Technical Secretariat, with the latter carrying
out the management of the data on indicators and the consulting information on them, have not been exceedingly
clear about the data provided to the beneficiaries. The Interact-developed list does not correspond fully to the
indicators used by the programme and the Joint Operational Programme list does not go sufficiently into detail
concerning how the indicators should be counted and what supporting evidence should be provided when reporting
indicators. This also means that the consultation provided by the Joint Technical Secretariat, although
knowledgeable, may become varied in practice.
The auditor would like to point out the following indicators specifically.
• “Members of the population who benefit from forest fire protection measures (percentage)” is an indicator
who’s counting as presented in the eMS system makes no sense, as there are individual items counted
instead of percentages calculated.
• There are indicators where items that are counted range from tens to hundred and more. Also, those items
may be counted over several different events from different reports. There is a risk that the beneficiary may
lack the knowledge and care to properly organize the data presented. Specifically, it should be clear that the
items are in line with the indicator principles and that no doubles are presented. This affects the following
indicators:
o “Number of enterprises that are substantially and actively involved in the projects as final
beneficiaries”.
o “Number of organizations using programme support for cooperation in education, R&D, and
innovation” (only for project ER89).
o “The number of participants at events that are aimed at vocational and language training”.
5 Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
9
Audit of management and control system – Final Report
o “The number of persons actively participating in environmental actions and awareness raising
activities”.
RISK: The auditor points out that defining and communicating the nature of indicators with as much detail as possible
is essential to minimize the risk of errors in counting them.
Even in situations where the information is not clearly stated in writing, but the beneficiaries are mostly uniform in
practice, the information should still be clarified because clarity in writing is a best practice for preventing future
mistakes.
RECOMMENDATION No 3.1 TO THE JOINT TECHNICAL SECRETARIAT: The auditor recommends the Joint Technical
Secretariat to adopt the following improvements concerning the indicators mentioned.
• For the indicator “Members of the population who benefit from forest fire protection measures
(percentage)”, the auditor recommends reviewing and possibly redefining the indicator to bring it in line
with the actual activities done and results achieved during the project.
• For all indicators but especially the indicators “Number of enterprises that are substantially and actively
involved in the projects as final beneficiaries”, “Number of organizations using programme support for
cooperation in education, R&D, and innovation” (only for project ER89), “The number of participants at
events that are aimed at vocational and language training”, and “The number of persons actively
participating in environmental actions and awareness raising activities”, the auditor recommends issuing
guidance that details the nature of indicators and the recommendations on counting and presenting them
in reports.
• The guidance thus issued should also be clearly and actively communicated to the beneficiaries, via all
channels used for that purpose.
The auditor also points out that the review of all indicators presented will become necessary during the closure of
the programme. Therefore, it would be prudent to begin this process promptly.
The auditor would also like to refer to audit finding 5.1, which concerns issues close to this finding.
COMMENT FROM THE JOINT TECHNICAL SECRETARIAT
The JTS fully agrees that for the indicator “Members of the population who benefit from forest fire protection
measures (percentage)” reviewing and possibly redefining of the indicator to bring it in line with the actual activities
done and results achieved during the project would be worthwhile, however such modification would require
significant changes of JOP. Currently there is awarded only one project focusing on this indicator and it has already
finalized its implementation. The JTS will inform JMC on this topic if any projects of 6th Call for proposals have
selected this indicator.
The JTS agrees that using COI would be beneficial for more clarity for programme bodies and beneficiaries. At the
same time in JOP there are many ERI – programme specific indicators.
There are only 4 contracted projects in the final phase of implementation, but for the projects to be contracted for
the 5th and 6th Calls for proposals JTS will prepare a guidance document that details the nature of indicators and
the recommendations on counting and presenting them in reports. The possible timing for that would be March-April
2023.
As usual JTS will communicate the guidance through all channels – programme webpage, direct information e-mails,
seminars/webinars on projects implementation and reporting, daily consultations, etc.
In addition, the JTS would like to inform that for some webinars for beneficiaries in 2021 the JTS invited a project
ER65 “BioAware” to share their experience on counting of unique participants, however it was just an example of
good practice and was not made as requirement for other beneficiaries.
FINAL COMMENT FROM THE AUDITOR
The auditor agrees with the follow-up actions proposed by the Joint Technical Secretariat and will monitor their
implementation into practice during the year 2023.
10
Audit of management and control system – Final Report
Key requirement 4: Adequate management verifications
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 4 works, but some improvements are needed
(Category 2) 6
Finding No 4.1 - The checklist used for management verifications of progress reports should be
improved in some respects (significant)
In accordance with article 26 p. 5 (a) of the Commission Implementing Regulation (EU) No 897/2014, the Managing
Authority shall verify that services, supplies or works have been performed, delivered and/or installed. In accordance
with p. 6 (a), (b) of the same article, this shall include administrative verifications and on-the-spot verifications.
However, the auditor notes that the Managing Authority and the Joint Technical Secretariat, with the latter carrying
out the management of the data on indicators and the consulting information on them, have not included a separate
control question for checking that the indicators have been correctly reported and that the information is clearly and
unambiguously presented in the eMS electronic monitoring system in the checklist for progress reports. The relevant
control question is present on the on-the-spot checklist, but on-the-spot checks may be used only once during the
project’s duration. The progress reports, on the other hand, are crucial for following the project’s progress and
therefore the checks on indicators are essential there.
RISK: The auditor points out that whenever the Joint Technical Secretariat fulfils a task, the written procedures
should support all important aspects of that task to minimize the risk that some aspects are overlooked or not
checked in a uniform manner.
Stating the task of verifying the indicators reported in the checklist and adding information in the checklist for the
person using it to elaborate on the nature of the checks they are supposed to carry out would ensure the Joint
Technical Secretariat’s assurance that all persons perform the checks concerning the indicators in the same way
and that the information concerning the indicators is always presented similarly.
RECOMMENDATION No 4.1 TO THE JOINT TECHNICAL SECRETARIAT: The auditor recommends the Joint Technical
Secretariat to update the checklist used for verifications of progress reports to include the verifications of indicators
along with clarifying notes for their correct count and necessary support documentation.
COMMENT FROM THE JOINT TECHNICAL SECRETARIAT
Based on Audit recommendation in 2021, the JTS updated checklist in eMS by adding 2 subpoints to the Question
13 (Q13). They are Q 13.1. “The project is progressing in line with planned achievement of output indicators; in case
of delays, explanations are provided” and Q 13.2. “Project is implemented in line with the environment, sustainable
development, equal opportunity requirements, non-discrimination as it is stated in application under section
Horizontal Principles (Cross-cutting issues)”.
However, the JTS must admit that those changes were not introduced to the JMC for the approval of the check-list
updates. This can be done immediately via JMC written procedure or introduced and approved by the JMC at its next
meeting in the end of April.
FINAL COMMENT FROM THE AUDITOR
6
Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
11
Audit of management and control system – Final Report
The auditor agrees with the follow-up actions proposed by the Joint Technical Secretariat and considers the finding
closed.
Key requirement 5: Effective system in place to ensure that all documents regarding expenditure
and audits are held to ensure an adequate audit trail
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 5 works, but some improvements are needed
(Category 2) 7
Finding No 5.1 - The requirements concerning clarity and ease of understanding of the information
presented by the beneficiaries should be updated and uniformly enforced (significant)
In accordance with article 26 p. 2 (d) of the Commission Implementing Regulation (EU) No 897/2014, the Managing
Authority shall establish and maintain a computerized system to record and store data on each project necessary
for monitoring, evaluation, financial management, control, and audit.
As set out in the Description of management and control system of the Estonian EU external border programme
(Estonia-Russia CBC programme 2014-2020), the electronic monitoring system (eMS) is used as the database for
information management.
However, the auditor notes that although the eMS electronic monitoring system allows the beneficiaries to present
the data on indicators in the progress reports in a clear and understandable way along with the supporting evidence,
the data is not often presented in that way in practice.
There are indicators where items that are counted range from tens to hundred and more. Also, those items may be
counted over several different events from different reports. There is a risk that the beneficiary may lack the
knowledge and care to properly organize the data presented. Specifically, it should be clear that the items are in line
with the indicator principles and that no doubles are presented.
In practice, the data presented for the indicators may exist in files where that information may be difficult or
impossible to easily copy for counting purposes. Also, though special sections in the progress report exist for that
purpose, many beneficiaries do not clearly describe fulfillment of the indicators within the progress description box,
neither do they use the specific section created for uploading supporting evidence meant specifically for the
fulfillment of the indicators, instead presenting them along with other general supporting documents
RISK: The auditor points out that information should be collected in a way that is easily understandable and easily
retraceable afterwards. There is a risk that information presented otherwise may be hard to manage for controllers
and the information may even become unmanageable once the controllers with experience of directly working with
the project have left the organization.
RECOMMENDATION No 5.1 TO THE JOINT TECHNICAL SECRETARIAT: The auditor recommends the Joint Technical
Secretariat to issue guidelines to the beneficiaries concerning how to present indicator data in reports. This should,
at minimum, include the requirement that the beneficiary should always clearly write up the explanation for every
number counted and reported under the indicators, and that the beneficiary should add the respective supporting
evidence to the specific section next to the indicators. For any indicators counted in tens to up to hundred items, a
7 Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
12
Audit of management and control system – Final Report
system should be set up where the information is also presented in tables that allow for calculation of numbers and
matching identification.
This information should also be clearly and actively communicated to the beneficiaries, via all channels used for that
purpose.
The auditor also points out that the review of all indicators presented will become necessary during the closure of
the programme. Therefore, it would be prudent to begin this process promptly.
The auditor would also like to refer to audit finding 3.1, which concerns issues close to this finding.
COMMENT FROM THE JOINT TECHNICAL SECRETARIAT
The JTS will prepare a guidance document that details the nature of indicators and the recommendations on
counting and presenting them in reports. Needed templates of tables will be prepared as annexes to this guidance,
too. The possible timing for that would be March-April 2023.
The JTS will insure the proper communication of the guidance to the beneficiaries.
FINAL COMMENT FROM THE AUDITOR
The auditor agrees with the follow-up actions proposed by the Joint Technical Secretariat and will monitor their
implementation into practice during the year 2023.
Key requirement 6: Reliable system for collecting, recording, and storing data for monitoring,
evaluation, financial management, verification, and audit purposes, including links with electronic
data exchange systems with beneficiaries
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 6 works well. No improvements needed (Category 1)
8
No findings.
Key requirement 8: Appropriate procedures for drawing up the management declaration and annual
summary of final audit reports and of controls carried out
As the result of this audit, the auditor finds that the management and control system of the Estonia-Russia
Programme of this function regarded via the Key Requirement 8 works well. Only minor improvements needed
(Category 1)
Finding No 8.1 - There should be some random checks on the indicator data as presented for the
annual reporting (non-significant)
In accordance with article 26 p. 2 (b) of the Commission Implementing Regulation (EU) No 897/2014, the Managing
Authority shall draw up and, after approval by the Joint Monitoring Committee, submit the annual report and the final
8 Category 1 – Works well. No or only minor improvements needed
Category 2 - Works, but some improvements are needed
Category 3 – Works partially; substantial improvements are needed
Category 4 – Essentially does not work.
13
Audit of management and control system – Final Report
report to the Commission. That is also how the tasks are set out in the Description of management and control
system of the Estonian EU external border programme (Estonia-Russia CBC programme 2014-2020).
However, the auditor notes that the Joint Technical Secretariat is in practice carrying out the management of the
data on indicators and compiling information on them that is then presented to the Managing Authority. The
Managing Authority is mostly well-informed about the details of information presented that way but carrying out
random checks in some amount would enhance the assurance about that.
RISK: The assurance about the reality of indicators is an important part of reporting on the progress of the
programme. Without some number of random checks during the process, that assurance may be weakened.
RECOMMENDATION No 8.1 TO THE MANAGING AUTHORITY: The auditor recommends the Managing Authority to
incorporate some number of random checks on the indicator data into its process of drawing up and submitting the
annual report and the final report.
COMMENT FROM THE MANAGING AUTHORITY
Managing Authority agrees with the recommendation to incorporate a number of random checks on the indicator
data into the process of drawing up and submitting annual and final reports; and updates the Description of
management and control systems accordingly in the 1st half of 2023.
FINAL COMMENT FROM THE AUDITOR
The auditor agrees with the follow-up actions proposed by the Managing Authority and considers the finding closed.
14
Audit of management and control system – Final Report
ANNEX 1 – Summary opinion of the auditee’s management and control system
Key requirement Category 1 Category 2 Category 3 Category 4
Key requirement 1: Adequate separation of
functions and adequate systems for reporting
and monitoring where the responsible X
authority entrusts execution of tasks to
another body
Key requirement 3: Adequate information to
beneficiaries X
Key requirement 4: Adequate management
verifications X
Key requirement 5: Effective system in place
to ensure that all documents are held to X
ensure an adequate audit trail
Key requirement 6: Reliable system for
collecting, recording, and storing data for
monitoring, evaluation, financial management,
X
verification and audit purposes, including links
with electronic data exchange systems with
beneficiaries
Key requirement 8: Appropriate procedures for
drawing up the management declaration and
X
annual summary of final audit reports and of
controls carried out
Summary opinion of the auditee’s
X
management and control system
15
Pr. Ege Ello
Riigi Tugiteenuste Keskus Meie 28.02.2023 nr 10-5/1507-1
[email protected]
Süsteemiauditi lõpparuande
edastamine
Austatud pr Ello
Edastame Teile Cross-Border Cooperation Programme “Estonia-Russia” 2014-2020
juhtimis- ja kontrollisüsteemi auditi lõpparuande.
Täname Teid auditi läbiviimise jooksul antud abi ja koostöö eest.
Lugupidamisega
(allkirjastatud digitaalselt)
Kaur Siruli
Finantskontrolli osakonna juhataja
Auditeeriva asutuse juht
Lisa: auditi lõpparuanne 14+1 leheküljel
Sama:
Pr Unda Ozolina, Riigi Tugiteenuste Keskus (
[email protected])
Hr Urmo Merila, Riigi Tugiteenuste Keskus (
[email protected])
Mart Pechter 611 3152
[email protected]
Suur-Ameerika 1 / 10122 Tallinn / 611 3558 /
[email protected] / www.rahandusministeerium.ee
registrikood 70000272