Franck Sébert Your ref. 17/05/2022 No Ares
European Commission (2022)3736955
Directorates-General,
Employment, Social Affairs and Our ref. 16.06.2022 No 10-5/5182-1
Inclusion, Regional and Urban
Policy
Joint Audit Directorate for Cohesion
Reply: Analysis of the documents submitted under ESIF Article 138(b) and (c) of
Regulation (EU) No 1303/ 2013 (‘the CPR’) — legality and regularity aspects of the
annual control report, audit opinion, management declaration and annual
summary
Operational programme: 2014TC16RFCB050
Dear Mr. Sébert,
We have received your letter concerning the observation on the Annual Control Report
and the Audit Opinion related to the ongoing audit activities and the final impact for the
total error rate and residual total error rate.
The Annual Control Report which was submitted via the SFC2014 on 28th of February
2022 the Audit Authority reported a material total error rate 32,81% and a residual total
error rate of 24,80%. The high error rate was mostly influenced by the unfinished audits
of operations and errors found in one high-value item (project no Est-Lat 51). As the
initial audit sample brought a high residual total error rate due to just one operation then
Audit Authority extended the sample.
The Audit Authority carried out public procurement procedure to outsource the audit
activities for one additional project with the costs for six project partners (project no Est-
Lat55). The results for the public procurement were not finalized by the time submission
of the Annual Control Report and therefore the Audit Authority reported the expenditure
still being audited as 100% of risk.
The quality control of the outsourced audits of operations is finalized. The quality control
process was done in co-operation with the Member of the Group of Auditors. The Audit
Authority carried out the quality control of three audits of operations which were carried
out in the Estonian project partners level and the Latvian members of the Group of
Auditors carried out the quality control of additional three audits of operations which
were done on the level of project partners situated in Latvia. So, in total, one additional
Suur-Ameerika 1 / 10122 Tallinn / Estonia / +372 611 3558 /
[email protected]
www.rahandusministeerium.ee / Reg. code: 70000272
project, with the costs for six project partners was outsourced and the quality control was
done by the members of Group of Auditors.
Out of the six audits of operations (project no Est-Lat55) which were outsourced, one
contained errors in the total amount of 38 692,4 EUR (please see table below):
Ineligible Ineligible
Project Name of the Project Latvian partners Audited Expenditure Estonian partners Audited Expenditure
expenditure expenditure
Valka Municipality Valga Municipality
Est-Lat51 Valga-Valka Centre 2 634 700,56 655 959,54 1 752 415,27 435 642,84
Council (LP) Government
Est-Lat133 EstLat Translator Tilde SIA (LP) 128 931,21 0,00 Avatar 93 720,21 0,00
Latvian Country Tourism NGO West-Estonia
Est-Lat22 COASTAL HIKING 26 774,72 0,00 37 682,36 0,00
Association (LP) Tourism
Latvian Chamber of
Est-Lat63 ESTLAT-WBL Commerce and Industry 35 616,83 25,99 Civitta Estonia AS 45 810,11 0,00
(LP)
Kurzeme planning region Kõiguste Marina
100 393,70 0,00 0,00
(LP) NGO (PP) 305 895,50
Salacgriva port authority Municipality of
Est-Lat55 ESTLAT Harbours 482 960,17 0,00 0,00
(PP) Pärnu-Värati 407 918,00
Engure port authority Kihnu municipality
571 850,00 0,00 38 692,40
(PP) (PP) 462 756,00
Total 3 981 227,19 655 985,53 Total 3 106 197,45 474 335,24
The draft audit report was sent to the auditee (Kihnu Municipality) on 14th of June and
therefore the financial impact and total error rate is taken into account according to the
draft audit report. The Audit Authority has identified several non-compliances with the
Estonian Public Procurement Act and therefore the financial impact would be in total 38
692,4 EUR for this audit (restrictive conditions for performance of contracts are required,
cases where specific standards are required, the initial conditions of the contract were
substantially altered).
Taken into account all the audit findings which were already presented in the Annual
Control Report and the results for the additional audits (Est-Lat55) the Audit Authority
re-calculated the total error rate and residual total error rate and the results are the
following:
The total error rate for the expenditure declared 01.07.2020 – 30.06.2021 would
be 9,44% (please see Annex 1)
The residual total error rate for the expenditure declared 01.07.2020 –
30.06.2021 would be 1,91% (please see Annex 2)
The auditors’ conclusion would therefore be that the population is misstated and qualified
opinion with significant impact would be issued.
Yours sincerely,
(signed digitally)
Kaur Siruli
Head of the Audit Authority
Head of the Financial Control Department
Ministry of Finance of the Republic of Estonia
2
Enclosed:
Annex 1- TPER_Calculations 2022_recalculated
Annex 2- RTER calculation_2022_recalculated.
Kaisa Kallas +372 6113536
[email protected]
3
SAMPLE
Strata information Low Value Strata High Value Strata
N 44 2
n 3 2
Sample BV € 608 326,27 € 8 812 421,85
Strata BV € 5 894 711,37 € 8 812 421,85
Error estimation
Tolerable error (2%) € 294 143
Mean per unit method Ratio method
Projected population error (EE) € 1 388 115,25 € 1 387 985,69
Projected error rate 9,44% 9,44%
CONCLUSION Population misstated
Partner Project Reference Strata
Valga-Valka Centre Est-Lat51 High (LP)
Est-Lat Harbours Est-Lat51 High (LP)
LPs Sub-Total
Valga-Valka Centre Est-Lat51 High (PP)
Est-Lat Harbours (5 partners) Est-Lat55 High (PP)
PPs Subtotal
TOTAL HIGH VALUE STRATA
EstLat Translator Est-Lat133 Low (LP)
COASTAL HIKING Est-Lat22 Low (LP)
ESTLAT-WBL Est-Lat63 Low (LP)
LPs Sub-Total
EstLat Translator Est-Lat133 Low (PP)
COASTAL HIKING Est-Lat22 Low (PP)
ESTLAT-WBL Est-Lat63 Low (PP)
PPs Sub-Total
TOTAL LOW VALUE STRATA
TOTAL ALL VALUE STRATA
SAMPLE - Audit period 01.07.2020 – 30.06.2021
Total Low Value Strata High Value Strata
46 6,8% 100,0%
5 10,3% 100,0%
€ 9 420 748,12
€ 14 707 133,22
ation misstated
Amount of Expenditure
Value of Verification
LP audited Participating Country certified by Operation or
Checks
Payment Claim sampled
HIGH VALUE STRATA
Yes LV € 2 634 700,56 2 634 700,56
Yes LV € 100 393,70 66 748,23
€ 2 735 094,26 € 2 701 448,79
Yes EE € 1 752 415,27 1 752 415,27
Yes EE € 4 324 912,32 2 231 379,67
€ 6 077 327,59 3 983 794,94
€ 8 812 421,85 € 6 685 243,73
LOW VALUE STRATA
Yes LV 128 931,21 128 931,21
Yes LV 26 774,72 26 774,72
Yes LV 35 933,99 35 616,83
€ 191 639,92 € 191 322,76
Yes EE 93 720,21 93 720,21
Yes EE 158 911,05 37 682,36
Yes EE 164 055,09 45 810,11
€ 416 686,35 € 177 212,68
€ 608 326,27 € 368 535,44
€ 9 420 748,12 € 7 053 779,17
Audited % TOTAL 47,96%
06.2021
% Verified Ineligible Expenditure Error Rate Projected Operation Error
100,00% € 655 959,54 24,90% € 655 959,54
66,49% € - 0,00% € -
98,77% € 655 959,54 24,28% € 664 129,26
100,00% € 435 642,84 24,86% € 435 642,84
51,59% € 38 692,40 1,73% € 74 994,52
65,55% € 474 335,24 11,91% € 723 604,17
75,86% € 1 130 294,78 16,91% € 1 387 733,43
€ 1 130 294,78 15,75%
Average ineligible € 693 866,71
100,00% € - 0,00% € -
100,00% € - 0,00% € -
99,12% € 25,99 0,07% € 26,22
99,83% € 25,99 0,01% € 26,03
100,00% € - 0,00% € -
23,71% € - 0,00% € -
27,92% € - 0,00% € -
42,53% € - 0,00% € -
60,58% € 25,99 0,01% € 26,03
0,00%
Average ineligible € 8,68
74,87% € 1 130 320,77 16,02% € 1 387 759,46
EGESIF_15-0002-04 Annex 4
Calculation template for residual total error rate (RTER)
A Audit population
14 707 133
B Expenditure audited
7 053 779
C Errors found in the sample
1 130 321
D Total Error Rate (TER) after extrapolation
9,44%
E1 Amounts under Art 137.2 (ongoing assessment)
-
Other negative amounts deducting expenditure originally declared in the reference accounting
E2 -
year*
Population without ongoing assessment and without other negative amounts deducting
F=A-E1-E2 14 707 133
expenditure originally declared in the reference accounting year
G=D*F Amount at risk
1 388 353
Financial corrections relating to errors detected by AA or applied by the MA/CA if such corrections
H 1 130 321
intend to reduce the risks identified by AA
I=F-H Amount certifiable in the accounts
13 576 812
J=G-H Residual amount at risk
258 033
K=J/I Residual Total Error Rate (RTER)
1,901%
L=(J-0.02*I)/0.98 Amount of correction to reduce residual risk to materiality level (extrapolated financial correction) NA RTER not exceeding 2%
M=(J-L)/(I-L) Residual Total Error Rate (RTER) after extrapolated correction NA RTER not exceeding 2%
*Corrections included under H and the ones already deducted from the positive population when establishing audit population A (see
sampling GN section 4.6) shall not be part of these amounts.
Concerning negative amounts for the purpose of residual risk, please see the following clarifications:
1. Negative amounts withdrawing expenditure of previous accounting years cannot be included in the calculation of the residual risk.
2. For the purpose of calculating F, in addition to the amounts under ongoing assessment (E), the following negative amounts referring to
positive amounts declared in the reference accounting year can be also deducted from the base population A:
a) deductions not related to irregularities (for example transfer of operations from one programme to another)
b) corrections related to irregularities (other than the ones under H and the ones already deducted from the positive population when
establishing audit population A (see sampling GN, section 4.6). (For example, the corrections resulting from the management verifications
carried out on the expenditure declared in the reference accounting year can be deducted.)
A. Example of calculation of RTER - no amounts under ongoing assessments (with material error and
individual financial corrections bringing it down to the materiality level)
A Audit population 1000
B Expenditure audited 100
C Errors found in the sample 2,1
D Total Error Rate (TER) after extrapolation 2,20%
E1 Amounts under Art 137.2 (ongoing assessment) 0
Other negative amounts deducting expenditure originally declared in the
E2 reference accounting year 0
Population without ongoing assessment and without other negative
amounts deducting expenditure originally declared in the reference
F=A-E1-E2 accounting year* 1000
G=D*F Amount at risk (2.2%*1000) 22
Financial corrections relating to errors detected by AA or applied by
MSthe MA/CA if such corrections intend to reduce the risks identified by
H AA 2,1
I=F-H Amount certifiable in the accounts 997,9
J=G-H Residual amount at risk 19,9
K=J/I Residual Total Error Rate (RTER) 1,99%
B. Example of calculation of RTER - no amounts under ongoing assessments (with material error and
need to apply financial corrections)
A Audit population 1000
B Expenditure audited 100
C Errors found in the sample 2,1
D Total Error Rate (TER) after extrapolation 2,50%
E1 Amounts under Art 137.2 (ongoing assessment) 0
Other negative amounts deducting expenditure originally declared in the
E2 reference accounting year 0
Population without ongoing assessment and without other negative
amounts deducting expenditure originally declared in the reference
F=A-E1-E2 accounting year* 1000
G=D*F Amount at risk (2.5%*1000) 25
Financial corrections relating to errors detected by AA or applied by
MSthe MA/CA if such corrections intend to reduce the risks identified by
H AA 2,1
I=F-H Amount certifiable in the accounts 997,9
J=G-H Residual amount at risk 22,9
K=J/I Residual Total Error Rate (RTER): 22.9/997.9 2,29%
Amount of correction to reduce residual risk to materiality level
L=(J-0.02*I)/0.98 (extrapolated financail correction): (22.9-0.02*997.9)/0.98 3,0
Residual Total Error Rate (RTER) after extrapolated correction: (22.9-
M=(J-L)/(I-L) 3)/(997.9-3) 2,00%
C. Examples of calculation of RTER with amounts under ongoing assessments
C.1. Example with all the amounts under ongoing assessment outside the sample (with material error
and individual corrections bringing it down to the materiality level)
A Audit population 1000
B Expenditure audited 100
C Errors found in the sample 2
D Total Error Rate (TER) after extrapolation 2,20%
E1 Amounts under Art 137.2 (ongoing assessment outside sample) 50
Other negative amounts deducting expenditure originally declared in the
E2 reference accounting year 0
Population without ongoing assessment (1000-50) and without other
negative amounts deducting expenditure originally declared in the
F=A-E1-E2 reference accounting year* 950
G=D*F Amount at risk (2.2%*950) 20,9
Financial corrections relating to errors detected by AA or applied by
MSthe MA/CA if such corrections intend to reduce the risks identified by
H AA 2
I=F-H Amount certifiable in the accounts 948
J=G-H Residual amount at risk 18,9
K=J/I Residual Total Error Rate (RTER) 1,99%
C.2. Example with the amounts under ongoing assessment (partially) within the sample (with material
error and need to apply extrapolated corrections)
A Audit population 1000
B Expenditure audited 100
C Errors found in the sample 2
D Total Error Rate (TER) after extrapolation 2,20%
E1 Amounts under Art 137.2 (ongoing assessment) 50
Other negative amounts deducting expenditure originally declared in the
E2 reference accounting year 0
Population without ongoing assessment (1000-50) and without other
negative amounts deducting expenditure originally declared in the
F=A-E1-E2 reference accounting year* 950
G=D*F Amount at risk (2.2%*950) 20,9
Financial corrections relating to errors detected by AA or applied by
MSthe MA/CA if such corrections intend to reduce the risks identified by
H AA (excluding errors linked to amounts under Art 137.2) 0,5
I=F-H Amount certifiable in the accounts 949,5
J=G-H Residual amount at risk 20,4
K=J/I Residual Total Error Rate (RTER) 2,15%
Amount of correction to reduce residual risk to materiality level
L=(J-0.02*I)/0.98 (extrapolated financial correction) 1,439
M=(J-L)/(I-L) Residual Total Error Rate (RTER) after extrapolated correction 2,00%
Cell C61 (value of 0.5=2-1.5): in this exampe 1.5 is an irregular amount in the sample, which is part of the
expenditure under on-going assessment.
* For the purpose of simplification, it is assumed in this example that there are no such amounts.
Corrections included under H and the ones already deducted from the positive population when
establishing audit population A (see sampling GN section 4.6) shall not be part of these amounts.
See next sheet "Negative units example" for an example with different types of negative amounts.
Concerning negative amounts for the purpose of residual risk, please see the following clarifications:
1. Negative amounts withdrawing expenditure of previous accounting years cannot be included in the
calculation of the residual risk.
2. For the purpose of calculating F, in addition to the amounts under ongoing assessment (E), the
following negative amounts referring to positive amounts declared in the reference accounting year can
be also deducted from the base population A:
a) deductions not related to irregularities (for example transfer of operations from one programme to
another)
b) corrections related to irregularities (other than the ones under H and the ones already deducted from
the positive population when establishing audit population A (see sampling GN, section 4.6). (For
example, the corrections resulting from the management verifications carried out on the expenditure
declared in the reference accounting year can be deducted.)
Example illustrating treatement of different types of negative sampling units
A Audit population 1000
B Expenditure audited 100
C Errors found in the sample 2
D Total Error Rate (TER) after extrapolation 2,20%
E1 Amounts under Art 137.2 (ongoing assessment outside sample) 50
Other negative amounts deducting expenditure originally declared in the
E2 reference accounting year* 350
Population without ongoing assessment and without other negative
amounts deducting expenditure originally declared in thereference
F=A-E1-E2 accounting year* 600
G=D*F Amount at risk (2.2%*600) 13,2
Financial corrections relating to errors detected by AA or applied by the
H MA/CA if such corrections intend to reduce the risks identified by AA 2
I=F-H Amount certifiable in the accounts 598
J=G-H Residual amount at risk 11,2
K=J/I Residual Total Error Rate (RTER) 1,87%
The risk calculation is based on the following assumptions concerning negative sampling units:
250 negative sampling units withdrawing expenditure of previous accounting years (which should not be included in the calculation)
2 corrections relating to audit of operations (to be included in row H and not under F)
50 amounts under Article 137.2 (ongoing assessment)
100 *deductions not related to irregularities (such as transfer of several operations from one programme to another)
250 *corrections (other than the ones under H and the ones included in the positive population A) related to irregularities in expenditure declared in the reference accounting year
400 Total (without negative sampling units withdrawing expenditure of previous accounting years and without corrections included under H)
F=1000-400=600