ANNUAL PROGRAMME REPORT
FM14-21
Estonia
EE-LOCALDEV Local Development and Poverty Reduction
2020
1
A. EXECUTIVE SUMMARY
Year 2020 was the 1st full year of programme implemementation. The Programme
Agreement was signed in September 2019 and the launching conference took place in
November 2019, but the implementation reached full strength in 2020.
As of March 2020, Estonia as well as the rest of the world was taken by the Covid-19
crisis, but we were able to adapt and relocate most of the activities to virtual space.
Working with pre-defined project descriptions and texts and criteria of open calls was
nicely suited for this and no bigger setbacks followed. All consultations with FMO, donor
programme partners and National Focal Point as well as ministries responsible with
relevant policy areas could be and were executed via e-mail or virtual meetings. Two
Cooperation Committee meetings were carried out as well respectively on April 1
and September 29. Still, some delays occurred because of Covid-19 related urgent work
issues that had to be prioritised. The latter was mainly associated to Outcome 1 calls for
proposals regarding the educational topics, but by today this has been overcome.
At present, all 8 pre-defined projects earmarked in the Programme Agreement are
running. As said, some changes, delays have occurred due to Covid-19 situation, but the
projects have adapted and have carried out some activities virtually instead.
Nevertheless, an important obstacle was not being able to travel and enhance bi-lateral
relations with project partners. No terminations or essential changes took place and when
the world opens more up again in 2021-2023, then amendments can be made and bi-
lateral relations can be facilitated.
In 2020, programme launched and carried out call for proposals #3 and #5 as well
as small grant schemes #1a, #2 and #3. Texts and criteria of calls for proposals #2 and
#4 have been finalised and will be launched in January-February 2021.
The target groups of the programme have found the information concerning the
programme and the visibility of the programme good. Overall, all parties concerned -
Programme Operator, Implementing Agency, line ministries, National Focal Point - have
been active communicators and distributors of information regarding the programme. A
good source of overall picture is EEA and Norway Grants Estonia web-site that
accumulates all programmes and activities supported via the grants in Estonia and hence
builds bridges between different areas and target groups.
As the programme implementation has taken off well in 2020, then now the principal risk
can be associated with Covid-19, but in case year 2021 is going to normalise the life and
doings to a certain extent, then there is good chance that the programme can achieve its
results and goals by 2024.
B. PERFORMANCE
1. Results
Outcome 1: Enhanced wellbeing of children and youth
Outcome 1 includes one of the biggest policy changes in Estonia - introducing, adapting
and implementing restorative justice measures for children and youth who have been
caught in the criminal justice system. The pre-defined project steered by the Ministry of
1
Justice has made solid progress over a course of 2020 in spite of difficult Covid-19
situation. Juvenile delinquency network “Out of the Circle” has been initiated, city of
Tallinn is dealing with the Icelandic model of prevention, trainings on process
management and child-friendly process have begun, the system of volunteers in youth
offender-related mediation has begun etc. The 1st tranche of the small grants scheme
supporting restorative justice measures in Estonia has been carried out and selection
process is currently under way. The projects are to start in spring 2021. In autumn 2021
the 2nd tranche of the small grants scheme will be launched.
Pre-defined project by Social Insurance Board on renewed family mediation system has
been progressing also for 3 quarters, comparative analysis on other countries´ practices
has been carried out.
A small grant scheme on vocational education (career orientation year) has been carried
out and submitted project proposals are currently under evaluation. The projects are
expected to start in the 1st quarter of 2021. The open call on smart youth work is
launching in the end of January 2021 / start of February 2021 and the text and criteria of
the open call on educational support services to local governments is being compiled and
is expected to launch in the 2nd quarter of 2021.
Outcome 2: Reduced domestic and gender-based violence and gender inequalities
Outcome 2 activities have been progressing quite good.
Both, the small grant scheme and the open call has been carried out and projects to be
supported have been selected. 3 SGS projects alongside with 1 open call project should
start in January 2021.
A pre-defined project on victim support system had an opening seminar in the beginning
of March 2020 and although a few output indicators had to be changed due to the
changed circumstances after a long period of time had elapsed from the original project
description till the start of activities, the project is progressing nicely. The volunteers
supporting the victims of gender-based violence in cooperation with the official support
network have been found (47) and the indicator set for the programme (30) has already
been fulfilled.
Although the outcome level indicator “Annual number of victims of gender-based
violence assisted by the supported shelters” has already exceeded the target value of
2200 in year 2020, it is quite reasonable to deduce that it cannot be solely attributed to
the project activities. The Covid-19 situation has amplified the conflicts, the problems
with mental health have risen, the economic situation has worsened in many homes –
all this has unfortunately been also ignition to domestic violence and the rise in need
of help by the shelters.
A pre-defined project dealing with creating a virtual competence centre of gender equality
has been dealing mostly with information analysis and structure composition of the virtual
centre. Also, as required by the Programme Agreement, the Programme Operator’s
responsibilities regarding the verification of payment claims and the verification of the
project outputs of the project have been externalised and are being carried out by a legal
entity independent of and unrelated to the Programme Operator, i.e. KPMG Baltics Ltd.
Outcome 3: Improved quality of integrated services and public health interventions at local
level
The pre-defined project by the University of Tartu dealing with physical activity of
schoolchildren had to adapt to the Covid-19 situation and did it well by introducing
2
different possibilities for physical activity in the distance learning environment, offering
alternatives and new ideas for schools and teachers. Also an idea-hub was created to
exchange best practices. Please see: https://ideed.liikumakutsuvkool.ee/. Altogether 98
schools have been engaged in implementing the physically active school model, of them
there are 12 schools with Russian as the language of instruction, that exceeds the
originally set target value of 8 Russian language schools.
The pre-defined project on public health competence and capacity of local governments
(project promoter National Institute for Health Development) has started to develop a
service design methodology as well as to adapt an intervention „Toybox“ for kids of 4-6
years of age in kindergartens in Estonia (prevention of obesity).
The pre-defined project "Development of evaluation model and handling system for
chronically mentally ill patients" (project promoter Viljandi Hospial) has been approved by
the donors and Programme Operator and will start in January 2021.
An open call on integrated services to support health and safety in home environment will
be launced on January 28, 2021.
Outcome 4: Historic town centres revitalised through heritage-based local development
The pre-defined project by the National Heritage Board started in June 2020 and has
already had in-person events in August (opening event) and in September 2020.
The open call on restoration of buildings in small towns with heritage protection areas
drew a lot of attention and by deadline Nov 30, 2020. The call received a lot of
applications with overall support request of 12,87 MEUR while only 2,86 MEUR of support
is available. The projects are currently in the evaluation phase and would hopefully start
by 2nd quarter of 2021. If possible, then additional financial support allocation to the call
would be of benefit to the overall result of the call.
Bilateral Outcome: Enhanced collaboration between beneficiary and donor state entities
involved in the programme
Covid-19 crisis has hampered in-person bi-lateral collaboration enhancement the most.
Projects have delayed some events or adapted and have carried out some activities
virtually instead. Bi-lateral activities approved by the programme cooperation committee
(Ministry of Justice and Ministry of Culture) that were supposed to be carried out in 2020
have been postponed to 2021-2022. Nevertheless, when the world opens more up again
in 2021-2023, then bi-lateral relations can be facilitated at full strength.
Cooperation with the Donor Programme Partners – Norwegian Directorate of Health,
Norwegian Institute of Public Health and Norwegian Directorate for Cultural Heritage –
have been actively participating in the steering of the programme. For instance, the
representative of the Norwegian Directorate of Health participated as a member of the
Selection Committee in the open call and small grant scheme of Outcome 2. The donor
partners have been very concerned about bi-lateral relations and creating bi-lateral
partnerships between Estonian and donor country organisations. The communication has
been via virtual channels mostly, but as soon as the Covid-19 situation allows, then also
face-to-face events and activities with the donor partners will be carried out.
3
2. Implementation
Conformity with specific requirements
PO has met all requirements posed by the Programme Agreement Annex I Section
"Conditions".
Additonally, special concernes highlighted in the Memorandum of Understanding:
a) a maximum of € 3,000,000 of the programme grant shall be set aside for the
programme area ‘Cultural Entrepreneurship, Cultural Heritage and Cultural Cooperation’
and
b) the programme shall include measures that address integration of national minorities
have been followed in drawing up the programme concept and have been integrated in
the Programme Agreement.
Cooperation with International Partner Organisations (IPOs)
N/A
C. LEARNING
1. Monitoring
Moitoring is carried out in different forms:
a) via activity reporting and verification of payment claims
b) via target indicator level progess monitoring
d) via on-spot checks (risk-based, conducted for every project at least once)
e) via desk-based checks or participation
f) via random (unannounced) visits to project activities(for example trainings, meetings,
information days, seminars, supervisions, roundtables, etc.)
g) via meetings or written information gathering
h) via risk-based audits by the Auditing Authority.
-------------------------------------------------------------------------------
Regular, day-to-day basis monitoring contains monitoring via reporting, communication
with project promoters and random visits to events.
Reporting criteria
Project promoters have to submit interim activities report for every 12 months of
implementation and a project final report.
System and regularity of verification payment claims has been established (every 3
months) and are being carried out regularly as projects progress.
Minimum requirements for the verification of project expenditure are:
First expenditure report – 100% of submitted costs and the supporting documents are
checked;
The threshold of comparative offers starts from 5 000 euros, but the general principles of
using funds economically and purposefully, awarding the contract based on the best price-
quality ratio (Public Procurement Act § 3) applies horizontally to all levels of procurement;
In the following interim expenditure reports a sample based review of costs and supporting
documents is conducted.
4
If as a result of expenditure check non-eligible costs are identified, then the sample will be
expanded so that all same types of costs will be checked also in the following expenditure
reports.
During 2020 the main type of monitoring used was the via activity reporting and verification
of payment claims in collaboration with first progress indications at target indicator level.
No irregularities were found in projects, still a irregularity was detected, reported and grant
in the amount of 42,40 euros reclaimed in the management costs of the programme.
For the upcoming year on-spot checks, random visits, meetings with projects and desk-
based checks will be included to the monitoring activities´ list.
2. Evaluation
No evaluation was carried out in 2020. In addition to risk based evaluation carried out by the
Auditing Authority in the coming years, the Programme Operator will carry out an impact
evaluation of the programme in 2024.
3. Lessons learned
As MoU was signed in May 2017 and the Programme Agreement in Sept 2019, i.e. the
programme started over 2 years after the conclusion of the MoU and stakeholder
consultations that took place already in June 2017. That meant disappointment from
target groups, possible in-between changes in the policy area, doubts whether the time to
reach objectives is sufficient regarding the programme deadline etc. modified or
changed. Also, bi-lingual programme action and two level project selection process is time
and resource consuming, although quite understandable from the point of view of the
donors.
All in all, the main lesson learned is that when planning a time line one has to take into
account all these aspects and add all sorts of possible delays. Still, at present the
progress of the programme indicates that the programme is likely to achieve its expected
outcomes, except maybe not all bi-lateral outcomes due to the COVID outbreak and
complicated international travel / co-operation circumstances.
D. ANNEXES
1. Updated results (indicator achievements)
2. Communication
3. Overview of contracted projects
4. Risk management
5. Monitoring plan
6. Evaluation report
7. List of individual mobilities
5
Annex 1: Updated results (indicator achievements)
Objective: Strengthened social and economic cohesion
Outcome 1: Enhanced wellbeing of children and youth
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Share of educational institutions involved in
programme activities reporting increased
Percentage N/A - Reported 2021, 2024 70.00 % -
coordination of local level integrated
support services
Share of youth reporting readiness to
continue studies or enter the labour market
Percentage N/A - 0 0 - 50.00 % -
after using the services provided via this
programme
National prevalence of juvenile offending
Percentage 18.00 % - Reported 2021 16.00 % -
(self-reported)
Share of sentenced juvenile offenders
receiving special juvenile measures instead Percentage 16.00 % - 0 0 - 30.00 % -
of punishment
Annual number of youth offender-related Annual
23 - - - 34 100 -
cases mediated number
Number of families who received the family
Number 0 - - - 0 600 -
mediation during the pilot
Share of local governments involved in
programme activities applying smart Percentage - - 0 0 - 60.00 % -
solutions in youth work
Output 1.1: Specialised juvenile justice system approach introduced / launched
Achievements Achievements until end of December
Unit of
Indicator Baseline until end of 2020 Target Comment
measurement
previous
Numerator Denominator Value
6
reporting
period
Specialised training programme for juvenile
Binary No No (IFR 2020) - - No Yes -
justice staff developed
Number of tools for assessment and multi-
agency cooperation piloted and Number 0 1 (IFR 2020) - - 0 3 -
implemented
Number of interventions developed to
replace fines and avoid institutionalization Number 0 0 (IFR 2020) - - 1 4 -
for youth
Number of closed youth facilities receiving
support to introduce new methods and
Number 0 0 (IFR 2020) - - 0 3 -
services in treatment of delinquent and
victimized youth
Number of criminal justice system (CJS) staff previous period info falsely
who work with juveniles that attended Number 0 116 (IFR 2020) - - 0 150 submitted by the project
specialised training programme promoter
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 1.2: Restorative justice measures for youth developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of restorative justice awareness
Number 0 0 (IFR 2020) - - 0 2 -
raising campaigns carried out
Financial Mechanism
7
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Number of restorative justice initiatives
developed in criminal justice system, Number 0 0 (IFR 2020) - - 0 3 -
schools or wider
Number of restorative justice trainers
Number 0 0 (IFR 2020) - - 0 10 -
trained
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 1.3: Youth offender mediation volunteer system established
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
previous period info falsely
Number of prospective volunteers trained in
Number 0 30 (IFR 2020) - - 29 70 submitted by the project
youth offender-related mediation
promoter
Output 1.4: Family mediation system established
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of family mediators trained to offer
Number 0 0 (IFR 2020) - - 0 40 -
qualified mediation service
Financial Mechanism
EEA Grants - - - - - 0 - -
8
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Number of family mediators trained to offer
qualified mediation service in Russian- Number 0 0 (IFR 2020) - - 0 20 -
speaking minority
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 1.5: Models for the provision of local-level integrated services developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of locally defined models for
Number 0 0 (IFR 2020) - - 0 15 -
integrated services provision developed
Number of professional staff trained Number 0 0 (IFR 2020) - - 0 150 -
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
9
Output 1.6: Pilots of service chains or tools (programmes) developed to enhance transitions of disadvantaged children and youth across school levels and from education to labour
market.
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of learners from vulnerable or
disadvantaged backgrounds (documented Number 0 0 (IFR 2020) - - 0 75 -
cases) supported
Number of innovative local level school
transitions service chains or tools
Number 0 0 (IFR 2020) - - 0 15 -
(programmes) designed for specific target
groups
Output 1.7: Smart solutions in youth work deployed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of specialists who work with young
people and children trained to develop Number 0 0 (IFR 2020) - - 0 50 -
applications based on target group needs
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 1.8: Development and piloting of transition programmes (i.e. career orientation programmes) for youth at risk from basic education to VET
Unit of Achievements Achievements until end of December
Indicator Baseline Target Comment
measurement until end of 2020
10
previous
reporting Numerator Denominator Value
period
Number of learners in transition
Number 0 0 (IFR 2020) - - 0 400 -
programmes
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Number of VET institutions offering
Number 0 0 (IFR 2020) - - 0 15 -
transition programmes for youth at risk
Outcome 2: Reduced domestic and gender-based violence and gender inequalities
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Share of all shelters in the country
Percentage - - 0 0 - 80.00 % -
implementing quality measuring tool
System of volunteer support persons
created complementing the formal victim Binary No - - - Yes Yes -
support system
Number of users of the Virtual Competence
Centre of Gender Equality within 3 years Number 0 - - - 0 100,000 -
after establishment
Percentage of population not blaming
Percentage 53.00 % - Reported 2022 60.00 % -
victims of sexual violence
Percentage of population not blaming
Percentage 47.00 % - Reported 2022 55.00 % -
victims of domestic violence
Percentage of population in favour of
Percentage 53.00 % - Reported 2022 60.00 % -
criminalising the buying of sex
Annual number of victims of gender-based Annual
1,900 - - - 2,563 2,200 -
violence assisted by the supported shelters number
11
Output 2.1: Volunteer support system for victims of gender-based violence developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of volunteers covered by the
volunteer support system for victims of Number 0 0 (IFR 2020) - - 47 30 -
gender-based violence
Output 2.2: Women’s shelter service upgraded
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of professional staff provided with
Number 0 0 (IFR 2020) - - 0 60 -
counselling sessions
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Quality measuring tools developed for
Binary No No (IFR 2020) - - No Yes -
shelter service developed
Output 2.3: The quality and capacity of intervention programmes for perpetrators of domestic violence increased
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of specialists trained in working
Number 0 0 (IFR 2020) - - 0 60 -
with perpetrators of domestic violence
Financial Mechanism
EEA Grants - - - - - 0 - -
12
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 2.4: Early warning system on domestic violence developed for the health care system
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Guidelines on detecting domestic violence
Binary No No (IFR 2020) - - No Yes -
developed
Number of medical staff trained on early
noticing and intervention for domestic and Number 0 0 (IFR 2020) - - 0 100 -
gender-based violence
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 2.5: Awareness raising activities on domestic and gender-based violence carried out
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of information campaigns on
domestic violence and gender-based
Number 0 0 (IFR 2020) - - 0 1 -
(involving men as positive role models)
carried out
13
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Number of short films on domestic violence
Number 0 0 (IFR 2020) - - 0 3 -
(aimed at children and youth) developed
Number of public opinion polls to measure
Number 0 0 (IFR 2020) - - 0 1 -
changes in attitudes carried out
Number of specialists trained on domestic
Number 0 0 (IFR 2020) - - 0 160 -
violence
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Output 2.6: Awareness raising activities on prostitution and trafficking for sexual exploitation carried out and social programme for sex buyers developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of awareness raising activities
implemented to discourage the demand for Number 0 0 (IFR 2020) - - 0 2 -
commercial sex
Number of social programmes for sex
Number 0 0 (IFR 2020) - - 0 1 -
buyers developed
Number of people reached by awareness
raising activities on discouraging the Number 0 0 (IFR 2020) - - 0 12,000 -
demand for commercial sex
Output 2.7: Virtual Competence Centre of Gender Equality established
Unit of Achievements Achievements until end of December
Indicator Baseline Target Comment
measurement until end of 2020
14
previous
reporting Numerator Denominator Value
period
Virtual Competence Centre of Gender
Binary No No (IFR 2020) - - No Yes -
Equality established
Outcome 3: Improved quality of integrated services and public health interventions at local level
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of families that have received early
home visitation interventions during the Number 0 - - - 0 40 -
pilot
Number of schools implementing the
Number 79 - - - 98 140 -
physically active school model
Number of local governments implementing
Number 0 0 (IFR 2020) - - 0 20 -
evidence-based public health measures
Number of operational multi-sectoral teams
Number 0 - - - 0 18 -
implementing the integrated service model
Annual number of long-term mentally ill
Annual
patients that have received outpatient 35 - - - 0 55 -
number
coercive psychiatric treatment
Standardised cooperation and
communication model between the social
care, health and judicial sectors aiding Binary No - - - No Yes -
people with chronic mental problems
developed and implemented
Number of schools with Russian as the
language of instruction implementing the Number 6 - - - 12 8 -
physically active school model
Output 3.1: Local governments trained and counselled to implement evidence-based public health measures
15
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of local governments who have
Number 0 0 (IFR 2020) - - 0 60 -
received training/counselling
Output 3.2: Integrated service model developed and piloted
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Integrated service model developed Binary No No (IFR 2020) - - No Yes -
Integrated service model piloted Binary No No (IFR 2020) - - No Yes -
Output 3.3: Out-patient services for long-term mentally ill patients subjected to coercive treatment provided
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of additional service providers able
to provide outpatient care to long-term
Number 0 0 (IFR 2020) - - 0 5 -
mentally ill patients subjected to coercive
treatment
Output 3.4: The model improving the quality of psychiatric evaluations developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Model of multidisciplinary forensic
psychiatry committee adapted and piloted Binary No No (IFR 2020) - - No Yes -
in Estonia
16
Output 3.5: Model of physically active school developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of toolkits for active schools
Number 0 1 (IFR 2020) - - 5 6 -
developed
Number of trainings and seminars to
disseminate the model of physically active Number 0 11 (IFR 2020) - - 66 80 -
school
Output 3.6: Home visitation early intervention model developed
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Home visitation early intervention model
Binary No No (IFR 2020) - - No Yes -
piloted in Estonia
Number of specialists trained to perform
home risk-assessment, including practicing Number 0 0 (IFR 2020) - - 0 500 -
midwives and family nurses
Financial Mechanism
EEA Grants - - - - - 0 - -
Norway Grants - - - - - 0 - -
Gender
Female - - - - - 0 - -
Male - - - - - 0 - -
Not specified - - - - - 0 - -
Outcome 4: Historic town centres revitalised through heritage-based local development
Achievements Achievements until end of December
Unit of
Indicator Baseline until end of 2020 Target Comment
measurement
previous Numerator Denominator Value
17
reporting
period
Number of cultural heritage buildings
Number 0 - - - 0 7 -
revitalised and in sustainable public use
Output 4.1: Cultural heritage buildings in small towns revitalized for community purposes
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of cultural heritage buildings
Number 0 0 (IFR 2020) - - 0 7 -
revitalised
Number of municipalities engaged in
Number 0 0 (IFR 2020) - - 0 7 -
projects
Number of VET schools and/or sustainable
renovation centres cooperating with Number 0 0 (IFR 2020) - - 0 5 -
cultural heritage revitalisation projects
Output 4.2: Capacity development on cultural heritage management provided at local level
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of municipalities from Estonia and
Norway receiving training on cultural Number 0 0 (IFR 2020) - - 2 20 -
heritage management
State type
Beneficiary State - - - - - 2 - -
Donor State - - - - - 0 - -
Not specified - - - - - 0 - -
Number of best practice books on cultural
Number 0 0 (IFR 2020) - - 0 1 -
heritage management published
Number of professionals trained Number 0 0 (IFR 2020) - - 20 300 -
18
Gender
Female - - - - - 13 - -
Male - - - - - 7 - -
Not specified - - - - - 0 - -
Bilateral Outcome: Enhanced collaboration between beneficiary and donor state entities involved in the programme
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
4.5,
Target is
≥4.5, and
an
Level of satisfaction with the partnership Scale 1-7 TBD - - - - -
increase
on the
baseline
value
Financial Mechanism
EEA Grants - - - - - - - -
Norway Grants - - - - - - - -
State type
Beneficiary State - - - - - - - -
Donor State - - - - - - - -
Not specified - - - - - - - -
4.5,
Target is
≥4.5, and
Level of trust between cooperating entities an
Scale 1-7 TBD - - - 1 -
in Beneficiary States and Donor States increase
on the
baseline
value
Financial Mechanism
19
EEA Grants - - - - - - - -
Norway Grants - - - - - - - -
State type
Beneficiary State - - - - - - - -
Donor State - - - - - - - -
Not specified - - - - - - - -
Share of cooperating organisations that
apply the knowledge acquired from bilateral Percentage N/A - - - - 50.00 % -
partnership
Financial Mechanism
EEA Grants - - - - - - - -
Norway Grants - - - - - - - -
State type
Beneficiary State - - - - - - - -
Donor State - - - - - - - -
Not specified - - - - - - - -
Bilateral Output 1: Cooperation between Donor and Beneficiary State entities supported
Achievements Achievements until end of December
until end of 2020
Unit of
Indicator Baseline previous Target Comment
measurement
reporting Numerator Denominator Value
period
Number of staff from beneficiary state
Number 0 0 (IFR 2020) - - 0 25 -
engaged in study tours to donor states
Number of projects involving cooperation
Number 0 6 (IFR 2020) - - 6 15 -
with a donor project partner
Financial Mechanism
EEA Grants - - - - - 3 - -
Norway Grants - - - - - 3 - -
Donor State
Norway - - - - - 6 - -
Iceland - - - - - 0 - -
20
Liechtenstein - - - - - 0 - -
Not specified - - - - - 0 - -
21
Annex 2: Communication summary
a. Visibility of the Grants and the donors
All parties involved (PO, Implementing Agency, projects) use the Grants logo (either EEA
or Norway or EEA and Norway) and reference to the source of the financial support is
made in press releases and social media and materials, presentations carried out in
projects. For the larger public, the distinction between EEA Grants and Norway Grants is
still somewhat unclear, but the PO is aware of this and monitoring the topic.
b. Communication with the National Focal Point
Communication with the National Focal Point has been very swift, operative and fruitful.
NFP has supported the PO in their compilation texts and criteria of calls for proposals as
well as steering the programme and with relevant changes.
c. Website and social media
Programme web-site gives up to date information both in Estonian an in English at
https://www.sm.ee/en/norway-grants-2014-2021. Information of all calls for proposals as
well as all financed projects are put up at the web-site of the programme in addition to
Programme Operator Implementing Agencys web-site and the projects' own web-sites.
The launch of calls will also include a press release and information distribution via
Facebook EEA and Norway Grants Estonia web-site.
d. Best practice examples
Maybe the most important best practice is that that the dissemination of information has
been backed up via different channels and therefore information to the public has been
available and easily accessible - PO web-site, Implementing Agency web-site, press
releases, grants Facebook page, ministries responsible for policy areas informing the
target groups and their umbrella organisations.
Also, all calls for proposals include informational seminars for applicants. Although the
Covid-19 crisis situation has messed up the possibility for organising events and travel,
then all info seminars have been carried out virtually via Zoom, have been recorded and
made public for watching afterwards.
e. Multimedia
N/A yet.
22
Annex 3: Overview of contracted projects
# of % of
donor Amount outcome
Outcome Projects #
project contracted budget
partners contracted
Pre-defined 2 2 € 5,105,625 46.02 %
Contracted through
Outcome 1: 0 0 €0 0.00 %
open calls
Enhanced wellbeing
Contracted through
of children and youth 0 0 €0 0.00 %
small grants scheme
Total Outcome 1 2 2 € 5,105,625 46.02 %
Pre-defined 2 2 € 735,000 65.92 %
Outcome 2: Reduced
Contracted through
domestic and 0 0 €0 0.00 %
open calls
gender-based
Contracted through
violence and gender 3 1 € 162,250 14.55 %
small grants scheme
inequalities
Total Outcome 2 5 3 € 897,250 80.47 %
Outcome 3: Pre-defined 3 2 € 4,029,000 88.96 %
Improved quality of Contracted through
0 0 €0 0.00 %
integrated services open calls
and public health Contracted through
0 0 €0 0.00 %
interventions at local small grants scheme
level Total Outcome 3 3 2 € 4,029,000 88.96 %
Pre-defined 1 1 € 458,000 13.80 %
Outcome 4: Historic
Contracted through
town centres 0 0 €0 0.00 %
open calls
revitalised through
Contracted through
heritage-based local 0 0 €0 0.00 %
small grants scheme
development
Total Outcome 4 1 1 € 458,000 13.80 %
Programme Total 11 8 € 10,489,875 52.30 %
23
Annex 4: Risk management
Programmatic risks
Risk Risk
Risk description Risk related to Likelihood Consequence Response type
score N/A?
Reducing social
Strengthening bilateral
and economic 1 2 1.41 No
relations
disparities
Description of
planned No practical legislative risks were detected concerning the programme activities
Activities to be implemeted are in some way
response
pre-conditional to the (changes) in legislation
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 2 2.00 No
disparities
Description of Detailed and realistic time-line that takes into account all actors (PO, IA, line
The launch of calls for proposals will be planned ministries, DPPs, FMO, translation etc) and leaves reasonable work-time (excluding
strongly delayed due to complicated response holidays)
implementation procedures Description of
actual Actual response = planned response
response
Planned future
Same action
response
24
Reducing social
and economic 2 3 2.45 No
disparities
Description of 2-3 evaluators per project, 2nd level evaluation by Selection Committee, clear
Non-competent project evaluations lead to planned evaluation criteria and instructions what point score constitutes to what situation,
financed projects with non-satisfactory response information seminars to evaluators
quality Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 2 2.00 No
disparities
Description of Wide communication amongst target groups by all line ministries. Consulting the
planned target groups while drafting the guidelines of call for proposals. Clear communication
Low interest among target groups in applying
response language and compliance with the target group needs
for grant support
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 3 2.45 No
Low quality projects lead to failure in disparities
achieving programme objective indicators Description of Clear and simple guidelines of calls for proposals. Information seminars for applicants
planned as well as for project promoters. Implementing Agency role in explaining the rules and
response regulations
25
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Strengthening
bilateral 2 2 2.00 No
relations
Strong interest from the Estonian side in engaging the DPPs into the process of
Description of
drawing up the guidelines and selection criteria of calls for proposals. Tight
planned
Poor cooperation with Donor Programme communication with the DPPs in finding Norwegian field experts and organisations
response
Partners and arranging best practice events
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Strengthening
bilateral 2 3 2.45 No
relations
Description of Tight communication with the DPPs in finding and encouraging Norwegian field
Low possibility of cooperation among
planned experts and organisations to cooperate with Estonia. Exchanging relevant contacts.
Estonian and donor state organisations at
response Re-scheduling and being flexible. Also, using digital solutions.
project level due to COVID 19 possible re-
Description of
emergence
actual Actual response = planned response
response
Planned future
Same action
response
26
Operational risks
Risk Risk
Risk description Risk related to Likelihood Consequence Response type
score N/A?
Reducing social
and economic 2 2 2.00 No
disparities
Description of Eligibility guidelines. Preventive communication between PO, IA, Auditing Authority in
Payments to projects will be delayed as there planned order to unify the positions. Clear feedback to Project Promoters (via e-mail, SFOS,
are problems with non-eligible costs and response and/or meetings)
irregularities Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 2 2.00 No
disparities
Description of Clear and simple guidelines of calls for proposals. Information seminars for applicants
Implementation of projects will be delayed as
planned as well as for Project Promoters. Implementing Agency role in explening the rules and
the project promoters are new to the rules
response regulations, especially to "newcomers"
and regulations (adminstrative burden)
Description of
accompanying the impementation process
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
Risk of financial corrections to projects
and economic 2 3 2.45 No
regarding mistakes in determining state aid
disparities
27
Description of Analysis of potential state aid while drawing up the guidelines of calls for proposals.
planned Trainings for PO and IA. State aid competence can be acquired from the Sate Aid
response Deparetment of MoF and in legal departments of line ministries.
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
Strengthening bilateral
and economic 2 2 2.00 No
relations
disparities
Description of Guidelines / information seminars / trainings for Project Promoters. Implementing
planned Agency advising and explaining the eligibility rules and procedures, on-the-spot
Risk of financial corrections to projects
response checks
regarding non-eligible costs
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
Strengthening bilateral
and economic 2 2 2.00 No
relations
disparities
Risk of financial corrections to projects Description of
Guidelines / information seminars / trainings for project promoters. Implementing
regarding non-compliance with the public planned
Agency advising and explaining the eligibility rules and procedures
procurement rules response
Description of
actual Actual response = planned response
response
28
Planned future
Same action
response
Both objectives 2 2 2.00 No
Description of
planned Invoice cross-check in the SFOS system
response
Risk of double financing Description of
actual Actual response = planned response
response
Planned future
Same action
response
Both objectives 1 2 1.41 Both objectives No
Description of
planned Cooperation with other Implementing Agencies, Tax and Customs Board and Police
response
Risk of fraud Description of
actual Actual response = planned response
response
Planned future
Same action
response
Both objectives 2 2 2.00 No
Description of
Clarifying the necessary information needed in different reporting chapters. Adjusting
Poor quality project reporting that leads to planned
the report, if necessary
inability to evaluate the performance and response
achievements of the projects Description of
actual Actual response = planned response
response
29
Planned future
Same action
response
Both objectives 2 2 2.00 No
Description of Programme Operator and Implementing Agency regular monitoring and feedback
planned from Project Promoters. PO needs analysis of project amendment proposals. PO
response timely and argumented proposals to the FMO to change the Programme Agreement
Inability to transfer the unused funds to other
Description of
activities within the programme
actual Actual response = planned response
response
Planned future
Same action
response
Both objectives 2 2 2.00 No
Description of Clear and simple indicator reopring forms. Explaining project promoters right from
planned the beginning the methodology, regulartity and content of the indicators to be
Problems and errors in gathering monitoring
response reported upon. PO and line ministries gather and monitor the progress of indicators
information (progress on output and outcome
Description of
indicators) as it is burdensome and difficult to
actual Actual response = planned response
understand for the project promoters
response
Planned future
Same action
response
Both objectives 2 2 2.00 No
Programme indicator target levels have been The indicator target levels have been set in 2017. As projects started the
already attained or set as unattainably Description of implementation in 2020 or will start in 2021, then the indicator levels might turn to be
unrealistic leading to the failure in achieving planned "out of date" as not relevant any more or already achieved. Annual monitoring of
the programme objectives response progress of outcome and output indicator target levels. Proposing changes, if
necessary
30
Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 2 2.00 No
disparities
Description of
Division and prioritization of responsibilities in the policy departments of line
Implementation of projects will be delayed as planned
ministries
there is insufficient human resources response
available in the PO and line ministries Description of
actual Actual response = planned response
response
Planned future
Same action
response
Reducing social
and economic 2 1 1.41 No
disparities
Preliminary consultations (while drawing up the guidelines of calls for proposals)
Conflict between rules and regulations set for
Description of between the Implementing Agency and the line ministries to compile the applicatiopn
the implementation of the financial
planned / reporting forms compatible with the SFOS system possibilities. Clear communication
mechanisms and electronical Structural Funds
response to the applicants on the technical and content requirements when submitting the
Operational System (SFOS) possibilities
proposal.
Description of
actual Actual response = planned response
response
31
Planned future
Same action
response
Reducing social
and economic 2 2 2.00 No
disparities
Description of Programme is under way, but the time-schedule is tight due to the delays in the
Substantial delays in time-schedule of the planned preparation process. Annual monitoring of the progress of activities / staying in the
programme lead to the risk of finishing response time-schedule. Proposing changes, if necessary
successfully the programme activities Description of
actual Actual response = planned response
response
Planned future
Same action
response
Both objectives 2 2 2.00 No
Preventive inquiries on the interpretation of rules and regulations of the financial
Description of
mechanisms. Raising questions and problems immediately and openly. Tight
planned
Inadequate communication between PO, IA, cooperation between the PO, Implementing Agency, National Focal Point and
response
DPPs and FMO leading to the loss of Certifying Authority.
important information on the implementation Description of
of the programme actual Actual response = planned response
response
Planned future
Same action
response
Overall risk of the programme
Risk
Likelihood Consequence
score
OVERALL RISK OF THE PROGRAMME 2 3 2.45
32
Annex 5: Monitoring plan
Please note this Annex is uploaded separately and is not visible in this document. Please
download and print separately if needed.
Annex 6: Evaluation report
Not Available
33
Tarmo Leppoja
Riigi Tugiteenuste Keskus
[email protected] Meie 08.02.2021 nr 2-6.3/420-1
Euroopa Majanduspiirkonna ja Norra toetustest
2014–2021 rahastatud programmi "Kohalik
areng ja vaesuse vähendamine" 2020. a
aastaaruanne
Lugupeetud Tarmo Leppoja
Edastame Teile Euroopa Majanduspiirkonna ja Norra toetustest 2014–2021 rahastatud
programmi "Kohalik areng ja vaesuse vähendamine" 2020. a aastaaruande.
Kinnitame, et programmi rakendamine toimub vastavuses Euroopa Majanduspiirkonna ja
Norra toetuste 2014–2021 rakendusmääruste ja siseriikliku seadusandlusega ning aruandes
kajastatu kirjeldab õigesti programmi tegelikku edenemist.
Lugupidamisega
(allkirjastatud digitaalselt)
Kalle Killar
e-teenuste arengu ja innovatsiooni
asekantsler
Lisad:
1. programmi „Kohalik areng ja vaesuse vähendamine“ 2020. a aastaaruanne
2. programmi „Kohalik areng ja vaesuse vähendamine“ 2021. a seiretegevuste plaan
Ülar Vaadumäe 626 9249
[email protected]
Suur-Ameerika 1 / 10122 Tallinn / 626 9301 /
[email protected] / www.sm.ee / registrikood 70001952
EEA and Norway Grants 2014-2021
Programme „Local Development and Poverty Reduction“
MONITORING PLAN 2021
Modality Project Promoter Monitoring Timing Criteria Risk issue Comments
Outcome
action (quarter)
No
PDP No 1 Ministry of Justice On the spot visit IV quarter Important and No risks identified
/random visit /II-IV large project yet – random
+ quarter monitoring
financial
monitoring
verifying regularly
project
expenditure
PDP No 2 Social Insurance Random visit II-IV Routine No risks identified
Board (unannounced) quarter monitoring yet – random
+ (checking the monitoring
Outcome 1
financial purposefulness
monitoring of the grant,
1
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
SGS Projects to be
(restorative justice) contracted in 2021 Q1
Open call Projects to be
(youth work) contracted in 2021 Q2
SGS Projects to be
(vocational education) contracted in 2021 Q1
Open call Projects to be
(LG support) contracted in 2021 Q3
PDP No 3 Social Insurance Random visit II-IV Routine No risks identified
Board (unannounced) quarter monitoring yet – random
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
PDP No 4 Ministry of Social Random visit II-IV Routine No risks identified
Affairs (unannounced) quarter monitoring yet – random
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
Outcome 2
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
SGS NGO VAITER Random visit II-IV Routine No risks identified Project launch in
(unannounced) quarter monitoring yet – random 2021 Q1
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
SGS NGO Pärnu Women Random visit II-IV Routine No risks identified Project launch in
Shelter (unannounced) quarter monitoring yet – random 2021 Q1
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
SGS NGO Eluliin Random visit II-IV Routine No risks identified Project launch in
(unannounced) quarter monitoring yet – random 2021 Q1
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
Open call NGO Eluliin Random visit II-IV Routine No risks identified Project launch in
(unannounced) quarter monitoring yet – random 2021 Q1
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
PDP No 5 University of Tartu On the spot visit/ IV quarter/ Important and No risks identified
Outcome 3
random visit II-IV large project yet – random
+ quarter monitoring
financial
monitoring
verifying regularly
project
expenditure
PDP No 6 National Institute for Random visit II-IV Routine No risks identified
Health Development (unannounced) quarter monitoring yet – random
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
PDP No 7 Viljandi Hospital Financial No risks identified
monitoring yet – random
verifying regularly monitoring
project
expenditure
Open call Projects to be
(health and social) contacted in 2021 Q2
PDP No 8 Heritage Board Random visit II-IV Routine No risks identified
(unannounced) quarter monitoring yet – random
+ (checking the monitoring
financial purposefulness
monitoring of the grant,
Outcome 4
verifying regularly whether the
project activities take
expenditure place,
disclosure
requirements
etc)
Open call Projects to be
(building restoration) contacted in 2021
Q1-2