Mr. Slawomir Tokarski Your ref. 30/05/2022 No Ares
European Commission, Directorate (2022)4008589
General, Regional and Urban Policy Our ref. 28.06.2022
European Territorial Cooperation, No 10-2/5434-1
Macroregions, Interreg and Programme
Implementation I
Reply: Analysis of the technical
part of the Annual Report and of
the documents submitted Article 68
of Commission
Implementing Regulation (EU) No
897/2014
Dear Mr. Tokarski
The Audit Authority wishes to thank you for the recommendations issued in your letter of
30/05/2022 concerning the Annual Audit Report and Opinion and to add comments and
explanations to the points mentioned therein.
TER/RTER calculation
In your letter, you have correctly stated that the sampling method used by the Audit Authority
was two-stage, stratified, non-statistical, equal probabilities sampling with population divided
into high value stratum and low value stratum. Subsequently, two more substrata are
introduced: expenditure relating to lead partners, and expenditure relating to other project
partners.
However, the Audit Authority wishes to point out for the sake of clarity that in this process,
the two stages need to be viewed separately. The first stage selects objects from the population
of projects to be audited (with a high value stratum and a low value stratum). In the second
stage, each selected project becomes a separate new population of partners, from which actual
objects to be audited are selected (with a stratum of lead partners and a stratum of project
partners).
This means that the strata of lead partners and project partners are used only on the level of a
project and not on the level of either the high value stratum or the low value stratum. In other
words, the book value of all lead partners and all project partners in both high and low value
stratum that you enquired for is not calculated or used in that approach.
It is also apparent in the table provided by the Audit Authority that accompanied the Annual
Audit Report. There is a small error in the table – the amount in the cell F24 should be the
same as the amount in the cell F25, but this has no effect on any of the calculations made.
Suur-Ameerika 1 / 10122 Tallinn / Estonia / +372 611 3558 /
[email protected]
www.rahandusministeerium.ee / Reg. code: 70000272
Regarding the extrapolation, there are differences between the strata of lead partners and
project partners. The stratum of lead partners on the level of a project always has a population
of one object. Therefore, any error found therein does not need to be extrapolated to the
stratum. The stratum of project partners, however, may have several objects. Therefore, any
error found in auditing one project partner out of many needs to be extrapolated to the level
of all project partners. By carrying this out, we will find the extrapolated error for the level of
the project that was originally selected to be audited.
The Audit Authority has included both the tables of sampling and extrapolation with this
letter. We will also include the relevant numbers herein:
Projects selected: ER2 (book value 1 160 853.42), ER126 (book value 166 890.61),
ER48 (book value 86 419.96).
ER2 book value of lead partner: 56 055.56, book value of all other project partners 1
104 797.86.
ER126 book value of lead partner: 9 952.23, book value of all other project partners
156 938.38.
ER 48 book value of lead partner: 30 173.44, book value of all other project partners
56 246.52.
Therefore, we currently find no errors in our approach. Should you have more questions,
comments, or recommendations, please let us know.
1. Audit strategy
You are correct in pointing out that the changes made to the Audit Strategy should be reflected
in the Annual Audit Report. The Audit Authority wishes to point out that among the
documents sent there was the latest version of the Audit Strategy updated to show the changes
made. The Audit Authority concurs that the Annual Audit Report should also show those
changes and will do as recommended when compiling the next Annual Audit Report. In
addition, the Audit Authority will include elaborations in the next Annual Audit Report
concerning:
The extent of the work to be performed for the system audits concerning the scope,
key requirements and bodies involved.
The method used in to determine the number of elements selected in the audit of
operations and the way elements are selected.
The work carried out for the audit of accounts.
2. System audit report
In your letter, you pointed out that the system audit report finalized in June of 2021 was
provided only in March of 2022 upon request. The Audit Authority wishes to point out that
the report was provided already along with the other additions made to the previous Annual
Audit Report in July of 2021. However, the Audit Authority concurs that the fact was not
clearly referenced in the Annual Audit Report itself and will keep it in mind for similar cases
in the future.
3. Risk of fraud
2
You are correct in pointing out that the aspect of fraud risk and measures taken to mitigate it
deserve to be described in more detail in the Annual Audit Report. The Audit Authority will
do as recommended when compiling the next Annual Audit Report.
4. Level of assurance
You are correct in pointing out that the Annual Audit Report did not specify the level of
assurance for the audit opinion on the management and control system. The Audit Authority
wishes to point out that the level of assurance was specified in the separate Audit Opinion
issued together with the Annual Audit Report but concurs that it would be clearer to include
all necessary details in the Annual Audit Report as well. The Audit Authority will do as
recommended when compiling the next Annual Audit Report.
Yours sincerely,
(Signed digitally)
Kaur Siruli
Head of the Audit Authority
Head of the Financial Control Department
Ministry of Finance of the Republic of Estonia
Enclosed:
Audit Authority Sampling working document for the year 2021 in five (5) sheets.
Annual Audit Report TER calculation working document for the year 2021 in one (1) sheet.
Mart Pechter +372 611 3152
[email protected]
3
SAMPLE
Strata information Low Value Strata High Value Strata Total
N 24 2 26
n 2 1 3
Sample BV € 253 310,57 € 1 160 853,42 € 1 414 163,99
Strata BV € 2 374 369,17 € 3 417 524,36 € 5 791 893,53
Error estimation
Tolerable error (2%) € 115 838
Mean per unit method Ratio method
Projected population error (EE)
€ 17 580,15 € 13 732,08
Projected error rate 0,30% 0,24%
CONCLUSION Population not misstated
Partner Project Reference Strata LP audited
Common Peipsi 2 LP ER2 High (LP) Yes
LPs Sub-Total
Common Peipsi 2 PP ER2 High (PP) Yes
PPs Subtotal
TOTAL HIGH VALUE STRATA
LOCAL FIRE ER126 Low (LP) Yes
Via Hanseatica Plus ER48 Low (LP) Yes
LPs Sub-Total
LOCAL FIRE ER126 Low (PP) Yes
Via Hanseatica Plus ER48 Low (PP) Yes
PPs Sub-Total
TOTAL LOW VALUE STRATA
TOTAL ALL VALUE STRATA
SAMPLE - Audit period 01.07.2020 – 30.06.2021
Low Value Strata High Value Strata
8,3% 50,0%
10,7% 34,0%
Amount of Expenditure
Value of Verification
Participating Country certified by Operation or % Verified
Checks
Payment Claim sampled
HIGH VALUE STRATA
EE € 56 055,56 56 055,56 100,00%
€ 56 055,56 € 56 055,56 100,00%
RU € 1 104 797,86 518 848,84 46,96%
€ 1 104 797,86 518 848,84 46,96%
€ 1 160 853,42 € 574 904,40 49,52%
LOW VALUE STRATA
RU 9 952,23 9 952,23 100,00%
EE 30 173,44 30 173,44 100,00%
€ 40 125,67 € 40 125,67 100,00%
EE 156 938,38 146 284,11 93,21%
RU 56 246,52 8 691,98 15,45%
€ 213 184,90 € 154 976,09 72,70%
€ 253 310,57 € 195 101,76 77,02%
€ 1 414 163,99 € 770 006,16 54,45%
Audited % TOTAL 13,29%
Ineligible Expenditure Error Rate Projected Operation Error
€ - 0,00% € -
€ - 0,00% € -
€ - 0,00% € -
€ - 0,00% € -
€ - 0,00% € -
€ - 0,00%
Average ineligible € -
€ - 0,00% € -
€ - 0,00% € -
€ - 0,00% € -
€ 1 065,00 0,73% € 1 142,57
€ - 0,00% € -
€ 1 065,00 0,69% € 1 465,01
€ 1 065,00 0,55% € 1 465,01
0,58%
Average ineligible € 732,51
€ 1 065,00 0,14% € 1 465,01
#
Aruanne Summa
ER1 2 256 670,94
ER101 148 530,46
ER126 166 890,61
ER134 157 301,95
ER135 42 545,42
ER138 366 951,61
ER141 99 661,60
ER15 16 205,61
ER19 30 704,92
ER2 1 160 853,42
ER25 197 373,64
ER30 44 044,79
ER48 86 419,96
ER52 60 275,03
ER53 20 394,14
ER55 185 539,75
ER65 267 619,04
ER78 12 165,63
ER8 60 788,31
ER80 101 427,98
ER85 57 329,60
ER89 18 751,13
ER90 107 481,97
ER91 23 726,65
ER94 54 361,45
ER96 47 877,92
Kokku 5 791 893,53
#
No Project No Expenditure Sampled
1 ER1 2 256 670,94
2 ER2 1 160 853,42 Random 2
Total 3 417 524,36 34%
No Project No Expenditure Sampled
1 ER101 148 530,46
2 ER126 166 890,61 Random 2
3 ER134 157 301,95
4 ER135 42 545,42
5 ER138 366 951,61
6 ER141 99 661,60
7 ER15 16 205,61
8 ER19 30 704,92
9 ER25 197 373,64
10 ER30 44 044,79
11 ER48 86 419,96 Random 11
12 ER52 60 275,03
13 ER53 20 394,14
14 ER55 185 539,75
15 ER65 267 619,04
16 ER78 12 165,63
17 ER8 60 788,31
18 ER80 101 427,98
19 ER85 57 329,60
20 ER89 18 751,13
21 ER90 107 481,97
22 ER91 23 726,65
23 ER94 54 361,45
24 ER96 47 877,92
Total 2 374 369,17 11%
Sampling Estonia-Russia projects for the audit year 2021
Sampling principles: Non-statistical random sampling with stratification (two high value objects)
Sampling unit: Operation
Minimum of 5% of operations and 10% of the expenditure declared will be audited
Other requirements:
each year
Reference to the audit strategy: p 3.4.2
Sample parameters EUR
10 percent of certified expenditure (non-
high-value) 237 436,92
Sample 253 310,57
Total projects 24
5% of projects (non-high-value) 1,20
Sample 2
Sample drawn by: Mart Pechter
Sample approved by: Kaur Siruli
Sample co-ordinated with the GOA: 13.05.2021
cts for the audit year 2021
m sampling with stratification (two high value objects)
perations and 10% of the expenditure declared will be audited
%
10,0%
10,7% OK
100%
5,0%
8,3% OK
#
Priority Project Expenditure Name of the Project Reports Partners
TO6 ER2 1 160 853,42 Common Peipsi 2 1.1, 9
TO6 ER126 166 890,61 LOCAL FIRE 1.1, 2.1 5
TO1 ER48 86 419,96 Via Hanseatica Plus 2.1, 8
Sample - Sample -
% %
Partners expenditure
2 22,2% 574 904,40 49,5%
2 40,0% 156 236,34 93,6%
2 25,0% 38 865,42 45,0%
#
Project Name of the Project Lead Partner
ER2 Common Peipsi 2 Setomaa Municipality Government
ER126 LOCAL FIRE Administration of the Pskovskiy area
ER48 Via Hanseatica Plus Foundation Tartu County Tourism
Project Partners
Tartu City Government
Luunja Rural Municipality Government
Mustvee Rural Municipality Government
Alutaguse Rural Municipality Government
Räpina Rural Municipality Government
Committee for economic development and investment policy of the Pskov region
Administration of the Pskovsky area
Municipal enterprise of the Pskov city “Gorvodokanal”
Alutaguse Municipality Government
Administration of the Gdovskiy area
Administration of the Pechorskiy area
Administration of the Palkinskiy area
Foundation Museums of Virumaa
Foundation Ida-Viru County Enterprise Centre
Info-tourist Centre of Leningrad Region
Administration of Vyborg municipal district
Committee of Cross-border Cooperation and Tourism Pskov City Administration
Gatchina municipal distгict of Leningrad region
St. Petersburg City Government State Geological Unitary Company "Mineral"
Russian Partners
Estonian Partners
#
Project Name of the Project Lead Partner
ER2 Common Peipsi 2 Setomaa Municipality Government
ER126 LOCAL FIRE Administration of the Pskovskiy area
ER48 Via Hanseatica Plus Foundation Tartu County Tourism
Expenditure
56 055,56
9 952,23
30 173,44
Project Partner
Administration of the Pskovsky area
Alutaguse Municipality Government
St. Petersburg City Government State Geological Unitary Company "Mineral"
Expenditure
518 848,84 Russian Partners
146 284,11 Estonian Partners
8 691,98