WORLD HEALTH ORGANIZATION
ORGANISATION MONDIALE DE LA SANTÉ
WELTGESUNDHEITSORGANISATION
ВСЕМИРНАЯ ОРГАНИЗАЦИЯ ЗДРАВООХРАНЕНИЯ Date: 03 September 2019
REGIONAL OFFICE FOR EUROPE
BUREAU RÉGIONAL DE L’EUROPE Mr Tanel Kiik
REGIONALBÜRO FÜR EUROPA Minister of Social Affairs
ЕВРОПЕЙСКОЕ РЕГИОНАЛЬНОЕ БЮРО
Ministry of Social Affairs
Head office: Suur-Ameerika 1
UN City, Marmorvej 51,
DK-2100 Copenhagen Ø, Denmark
10129 Tallinn
Tel.: +45 45 33 70 00; Fax: +45 45 33 70 01 Estonia
Email:
[email protected]
Website: http://www.euro.who.int
Our reference: Your reference:
Notre référence: Votre référence:
Unser Zeichen: Ihr Zeichen:
См. наш номер: На Ваш номер:
Dear Sir,
Accreditation for 2020 of the WHO national reference laboratory for measles and rubella,
Tallinn, Estonia
The elimination of measles and rubella is a goal of the WHO European Region, and is considered a
regional priority, as reflected in WHO Regional Committee for Europe resolution EUR/RC64/R5 and
in the European Vaccine Action Plan (EVAP). The elimination of measles and rubella is one of the six
main objectives of the EVAP, which also has the target of ensuring sustained access by all 53 Member
States of the Region to WHO-accredited measles and rubella laboratories by 2020.
The mid-term review of the Global Strategic Plan for Measles and Rubella 2012–2020 emphasized
that high-quality, comprehensive epidemiological surveillance of disease cases, carried out with the
support of laboratory services, is essential for successful disease monitoring and for evaluation of the
programme’s efforts to ensure progress. WHO coordinates the global network of reference
laboratories for measles and rubella and guarantees the high quality of its work through its
accreditation programme, which consists of conducting an annual review of the quality of
laboratories, including external quality assessments and periodic visits to laboratories by the WHO
coordinator and/or their representative.
From 12 to 14 August 2019, the coordinator of the WHO European Laboratory Network for Measles
and Rubella, Dr Myriam Ben Mamou, and the Senior Virologist, Dr Sabine Santibanez from the
Robert Koch Institute, the regional reference laboratory for measles and rubella located in Berlin,
Germany, visited the national reference laboratory operating at the Health Board in Terviseamet,
Tallinn. The experts assessed the laboratory procedures and work practices, the collaboration with the
epidemiological surveillance system, and the contribution of the laboratory to the process of regional
verification of measles and rubella elimination.
Based on the assessment carried out and considering the performance data for 2018, the national
reference laboratory is provisionally accredited until 31 December 2020. The conclusions and
recommendations of the assessment are attached to this letter. I would like to take this opportunity to
thank you personally for the continued support of the national laboratory for measles and rubella in
Estonia and look forward to furthering our collaboration.
UN City, Marmorvej 51 Tel.: +45 45 33 70 00 Email:
[email protected]
DK-2100 Copenhagen Ø Fax: +45 45 33 70 01 Website: http://www.euro.who.int
Denmark
Please accept, Sir, the assurance of my highest consideration.
Yours very truly,
Dr Piroska Östlin
Acting Regional Director
Copy for information to:
Ms Elen Ohov, Adviser, European Union Affairs and International Co-operation Department, Ministry of
Social Affairs, Suur-Ameerika 1, 10122 Tallinn, Estonia
Ms Triin Uusberg, Head, European and International Coordination Department, Ministry of Social Affairs,
Suur-Ameerika 1, 10129 Tallinn, Estonia
H.E. Mr Andre Pung, Ambassador, Permanent Mission of the Republic of Estonia to the United Nations Office
and other international organizations in Geneva, Chemin du Petit-Saconnex 28A, CH-1209 Genève,
Switzerland
H.E. Mr Märt Volmer, Ambassador Extraordinary and Plenipotentiary, Embassy of the Republic of Estonia,
Frederiksgade 19, 4th floor, 1265 Copenhagen K, Denmark
Ms Marge Reinap, Head of WHO Office, WHO Country Office, Estonia, Paldiski Road 81, 10617 Tallinn,
Estonia
–2–
Preliminary summary and recommendations of the accreditation review of the WHO
National Reference Laboratory for Measles and Rubella, Tallinn, Estonia.
A WHO accreditation visit to the National Reference Laboratory for Measles and Rubella, at the Health Board
– Terviseamet, Tallinn was conducted on 12-14 August 2019 by Dr Myriam Ben Mamou, WHO European
Regional Laboratory Coordinator and Dr Sabine Santibanez, Senior Scientist at the Robert Koch Institute,
Berlin, Regional Reference Laboratories to review activities, procedures and work practices of the laboratories
and examine the performance in 2018 and half 2019. The scope of the review is limited to Measles and
Rubella activity, as defined in the Measles and Rubella Accreditation Check-list1.
Following the findings of the visit, the sections of the measles and rubella laboratory accreditation check-list
scored 75% for General Review, 78% for Serology, and 90% for Molecular testing.
Based on this, the assessors recommend to:
• Provisionally accredit2 the NRL for measles and rubella serology,
• Hold accreditation decision for measles molecular activity until mEQA is passed.
• Conduct a control visit in 2020 to review the implementation of recommendations.
ESSENTIAL ACCREDITATION CRITERIA (Part I):
2018
Confirmatory test results of Sub-national Laboratories’ referred specimens are reported
1. 100%
within 14 days for ≥ 80% of specimens received:
Completeness: 92%
2. The laboratory reports monthly to WHO:
Timeliness: 92%
3. IgM tests are performed on at least 50 specimens annually: Measles: 146
Rubella: 146
Measles and Rubella IgM test results conducted for primary
4. diagnostics are reported by the laboratory within 4 days of Measles: 99.3%
receipt, for ≥ 80% of specimens Rubella: 94.5%
The accuracy of IgM detection is ≥ 90% (NLs sending sera to
Measles: 100%
5. RRL and SNLs to NLs for confirmatory testing) -
Rubella: 100%
18 measles and 25 rubella samples
Molecular tests are performed on at least 2 specimens per quarter, for measles and
6. No
rubella (RT-PCR, GT)
Score on most recent WHO Serology proficiency test is ≥ 90%:
7. Measles: 97.9%
PT panel number: 01802 Date reported: 11/12/2018
Rubella: 97.5%
Performance on most recent WHO Molecular EQA Measles Mol detection:
is passed (P) /re-test (R) (provisionally passed)/fail (F) Measles Sequencing:
8. Panel number for measles: Date reported: dd/mm/yy NA
Rubella Mol detection:
Panel number for rubella: Date reported: dd/mm/yy Rubella Sequencing:
For labs that conduct virus sequencing: Virus sequencing is completed
AND reported to WHO through MeaNS or RubeNS within 2 months of MeaNS; 0% (0/2)*
9.
receipt of specimens, for ≥80% of the specimens appropriate for genetic RubeNS: NA
analysis
10. Score from on-site review of laboratory operating procedures and practices is ≥ 80%: 81%
1 The 4 sections of the Checklist for annual WHO accreditation version for national and sub-national laboratories are
accessible here http://mrldms.euro.who.int
2 80% is the minimum required to pass each section.
1|P age
DETAILED ONSITE REVIEW SCORE (Part II)
Section 1 Section 2 Section 3
GENERAL SEROLOGY MOLECULAR
Pre-Analytical - 15 15
Analytical - 29 22
Post-Analytical - 24 17
Space 6 - 13
Staff 4 - -
Management & Supervision 11 - -
Document and record control 3 - -
Lab Info Management 5 - -
Biosafety 16 - 14
Equipment - 10 9
Supplies 10 - -
Cooperation 12 - -
Reporting to WHO 8 - -
Total 75 78 90
Score 75.0% 78.0% 90.0%
Global score 81.0%
BACKGROUND
The National Measles and Rubella Reference Laboratory for Estonia is hosted by the Health Board in Tallinn,
which is the competent authority for:
• Surveillance, prevention and control of communicable diseases;
• Outbreaks management;
• Supervision and monitoring of the National Immunisation Programme;
• Epidemiology statistics;
• Risk analysis in the field of epidemiology.
Surveillance and prevention of measles and rubella is guided by the CD Prevention and Control Act (§ 21, part
61 and 7), which came into force on 1 November 2003.
MR surveillance is:
• Mandatory
• Comprehensive
• Countrywide
• Passive
• Based on double notification (from GPs/hospitals and laboratories)
2|P age
Since 1995, the annual reported incidence of measles was decreased to 1 per 100 000 and to 0,8-0,6 per 100
000 in 1999-2000. Since 2001 occured sporadic cases mostly; with small outbreacs in 2006 (27 cases), 2018 (10
cases) and 2019 (25 cases).
The laboratory moved in the new Health Board building in 2017. In addition to its mandate as National
reference laboratory for Measles and Rubella, the laboratory has the following responsibilities:
• National Influenza Centre
• National reference laboratory for Polio and other Enteroviruses
• Laboratory for national communicable diseases surveillance and epidemic control system
• Participation in the work of European monitoring groups on different bacterial infections and in
WHO Salmonella Surveillance Group
• Diagnostic and confirmatory testing for bacterial and viral pathogens.
In case of measles suspected case matching measles case definition, the specimen in tested in parallel for
measles and rubella. When testing is requested by doctors in the absence of full case definition criteria,
consecutive testing for the 2nd virus is conducted on a selected number of negative specimens as instructed by
epidemiologists.
The MR NRL conducts measles and rubella serology (IgM, IgG), measles real-time RT-PCR and measles
genotyping RT-PCR. Sequencing is outsourced to Tartu Biocentre which provides raw sequences back to the
NRL for sequence management, interpretation and reporting to MeaNS.
There are 3 other laboratories in the country -nationally accredited- conducting measles and rubella serology,
the volume of MR serology analyses is higher in these national labs than in the NRL.
Tartu University performs measles and rubella serology, whereas Synlab (private lab) and West-Tallinn Central
hospital, the clinic of infectious diseases only conducts measles and rubella serology, respectively.
STRENGTHS AND ACHIEVEMENTS OF MR NRL
1. Modern, well-equipped laboratory, conducive to good laboratories practices
2. The laboratory is ISO 15189 accredited including MR serology
3. Commited and dedicated staff
4. The laboratory is collaborating well with the epidemiological surveillance system and reporting
results to the system in a timely manner
5. The timeliness and completeness of results reporting to WHO is satisfactory
6. Good performance at latest Measles and Rubella serology proficiency testing
7. IgM Retesting: 100% for measles and rubella.
8. Sufficient number of specimens are tested, either in parallel (case definition) or consecutively (in
the presence of symptoms and negative result to one test).
9. Well-organized samples reception, with a common system dispatching the specimens to different
sectors.
10. SOPs are in place for EIA tests, specimen processing, biosafety, qRT-PCR.
11. Equipment maintenance and calibration reports available.
12. Good procurement and stock management.
The assessors appreciate the context of transition, with recurrent changes in the management of the measles
and rubella activity and the recent nomination in February 2019 of the current head of MR reference activity
who has never participated in any WHO training or meeting.
3|P age
RECOMMENDATIONS
GENERAL (Score 75%)
1. Fully engage the lab in surveillance and verification process
- Ensure full access of the laboratory to the epidemiological surveillance database NAKIS to have full
clinical and epidemiological information for correct interpretation of lab results, identify the need for
additional laboratory investigations and more efficient management of results release to clinicians and
epidemiologists.
- The Laboratory should provide expert contribution to ASU, in particular comprehensive information
on molecular epidemiology of outbreaks and sporadic cases using MeaNS Distinct Sequence IDs,
with detailed data and annexes as appropriate, and review the entire final version of the ASU for
inconsistencies between different sections before submission by the NVC.
2. Formalize the role of NL toward other laboratories testing for measles and rubella:
- In the context of verification, laboratory investigation should be conducted in WHO-accredited or
proficient labs, performing annually a reputable external quality assurance (EQA) programme3.
Currently the NL only receives positive samples from the local laboratories for confirmatory testing
and for molecular testing / genotyping.
- For a comprehensive oversight of MR activity, the NL should also retest a representative set of
negative specimens from local laboratories, establish an annual measles and rubella proficiency testing
programme (similar to the annual WHO proficiency testing exercise for its network laboratories),
document the results and provide this information in the relevant sections of annual NVC report. The
NL is encouraged to set up and coordinate a national network of MR subnational laboratories in
order to supervise the performance of the local laboratories conducting MR testing and provide
technical guidance as appropriate.
3. Ensure sustainability and high quality for MR Reference activity:
3.1 Staffing issue: The high staff turnover observed during the past years should be addressed
and the number of staff should be adequate to handle the workload.
The reference activity of measles and rubella laboratory investigation requires sufficient staff to
address all the tasks with the expected quality and sustainability (technical and scientific validation,
quality management with document and records control and information management, shipment of
specimens for referral testing in Berlin RRL, training, supervision and coordination of EQA for other
labs, keeping up with WHO reference activity, preparedness for outbreaks).
- Over the past years, recurrent change in personnel in charge of measles and rubella reference activity
was an obstacle to stay correctly updated with WHO MR LabNet standards and requirements.
- Currently the serology is performed by one technician and the molecular activity by the head of MR
Lab, in addition to several other tasks. It is strongly recommended to recruit additional staff (at least
one technician) to correctly handle MR workload and implement quality assurance and supervision
according to WHO LabNet Standards. Retirements should also be anticipated for training and
handover to new staff handled adequately.
- The NRL is invited to closely collaborate with Berlin RRL. A training opportunity for the head of MR
lab is offered in 2019 – early 2020 at the Robert Koch Institute in Berlin (date to be confirmed) and in
future for the new technician.
3 http://www.euro.who.int/__data/assets/pdf_file/0009/247356/Eliminating-measles-and-rubella-
Framework-for-the-verification-process-in-the-WHO-European-Region.pdf?ua=1
4|P age
- WHO to provide access presentations and training material from 2016 and 2018 Regional meetings.
3.2 Funding: health authorities should allocate an annual budget to the Measles and Rubella
National Reference Laboratory to secure the quality and sustainability of the laboratory component of
MR surveillance (reagents, equipment maintenance, quality system management, information and data
management, staffing, coordination of national laboratory network, …). A Laboratory test costing
tool developed by EURO is available at http://www.euro.who.int/en/health-topics/Health-
systems/laboratory-services/better-labs-for-better-health/laboratory-test-costing
SEROLOGY (Score 78%)
4. Establish scientific validation in addition to technical validation: Supervisor or his/her delegate
to critically review test worksheets and results for accuracy and completeness before release,
evaluating them against internal quality controls to prevent their release in the event of quality
control failure, and indicate the need for any follow up actions.
5. Use in-house controls in all runs for all serology techniques (Measles IgM, IgG ; Rubella IgM,
IgG).
6. Amend the SOP for EIA to include:
- The use and interpretation of in house controls, including in assay validation (training in
RRL Berlin)
- Strict and systematic implementation of Westgard rules in xls sheets and software, both for
kit controls and in-house controls. In case of non-conformity, corrective actions should be
implemented, and results validated after the resolution of the issue.
- Scientific validation by supervisor in addition to technical validation
7. Establish a document control system. Only latest SOP version should be available to users in
printed and electronic format (currently 2017 version circulates although 2019 update was
developed).
8. Establish interfaces between instruments and lab information system to have an electronic flow
of result data and reduce the risk of manual errors.
9. EIA results are automatically calculated thanks to an xls macro. Records on serological assays
performed are printouts of xls macro where ODs are copied from EIA reader. Available
information comprises kit manufacturer, batch number, reagent expiry dates, calculation details,
assay validation details. However original raw data from EIA reader (OD) are not available
neither in electronic nor printed version. In addition to xls sheets, raw ODs should be printed
out and attached to each working sheet to allow traceability. Electronic records of ODs should
also be kept.
10. Potentially infectious material should be stored separately for non-infectious material (reagents)
in designated freezers/refrigerators; or at least in different shelves.
11. Perform specimen preparation and 1st step of EIA in a biosafety cabinet (BSC).
12. Harmonize the identification of specimens in all records (unique lab ID should be recorded on
working sheets to avoid errors).
13. Send original specimens from difficult cases (measles in vaccinated person; rubella suspicion in
pregnancy) in a timely manner to Berlin RRL for specific investigations (like IgG avidity).
5|P age
MOLECULAR (Score 90%)
14. Use specific and dedicated lab coats in each room (mix, extraction, post-amplification), with
different color code.
15. Investigate the cause of intermittent reactivity in qRT-PCR negative control (happening since
June 2019), with support of US CDC, and use different negative controls to analyze problems.
16. Establish an in-house control for qRT-PCR (support to be provided by Berlin RRL).
17. Store Genotyping RT-PCR run records in pdf format.
18. Store original specimens at -70 for one year at least.
19. Participate urgently in Measles Practice Panel exercise (new panel to be sent 20.08.2019 by
EURO, results of the panel sent in 2018 were never reported). Based on the outcome, decide
about mEQA round participation in Nov 2019 or 2020. In the meantime, qRT-PCR should not
be used alone for primary diagnostic (combine with serology), and Berlin RRL to reanalyze
original specimens in parallel before allowing submission to MeaNS by the NRL.
20. Chromatograms, sequences and phylogenetic trees are of good quality. Additionally, sequence
phylogeny should include the generation of genotype-specific phylograms with named strains.
21. The software for editing raw sequence data (BioEdit) should be accessible at the workplace for
correct management of sequences.
22. Results of local and temporal distribution of measles local variants should be presented in an
informative way in the NVC report to the RVC, examples are available in WHO VPD
Surveillance guidelines 2018 and support to be provided by Berlin RRL.
23. Ethidium Bromide should be replaced by a safer product (RRL Berlin to provide guidance)
24. BSC in the post-amplification room should be kept clean: used tips to be removed and DNA-
RNA cleaning solution used to decontaminate the BSC immediately after ending the procedure.
25. In case different fridges and freezers cannot be used to separate specimens and reagents storage,
separated shelves should be used.
26. In case of high CT values (38-40), RNA extraction should be performed again and both RNA
extracts amplified in the same run to be able to interpret the result.
27. A minimum of 2 tests per quarter should be done for each of qRT-PCR and sequencing. In case
of absence of specimens, RRL Berlin to provide materials and guidance.
28. Monitor and record daily the temperature on equipment in molecular suite, and back-up to be
organized during holidays.
29. Forward original specimens to Berlin RRL for rubella qRT-PCR in case of rubella suspected
cases.
ACKNOWLEDGEMENTS
WHO assessors are grateful to health authorities, senior management of the Estonian Health Board and to
Measles and Rubella Laboratory staff for the warm welcome and complete availability for the WHO visit:
• Merike Jürilo, General Director of Health Board,
• Irina Filippova, Chief Specialist, Communicable Diseases Surveillance and Control Department, Health
Board,
• Külli Rae, Head of Laboratory of Communicable Diseases, Health Board,
• Liidia Dotsentko, Head of Measles and Rubella Laboratory, Laboratory of Communicable Diseases,
Health Board,
• Team members of the Measles and Rubella Laboratory.
6|P age
Saatja: Biviano, Florencia <
[email protected]>
Saadetud: 04.09.2019 11:37
Adressaat: Tanel Kiik <
[email protected]>; Triin Uusberg
<
[email protected]>
Koopia: Elen Ohov <
[email protected]>; SM Info <
[email protected]>;
<
[email protected]>; <
[email protected]>; REINAP, Marge
<
[email protected]>; BEN MAMOU, Myriam Corinne <
[email protected]>;
<
[email protected]>
Teema: Accreditation for 2020 of the WHO national reference laboratory
for measles and rubella, Tallinn, Estonia
Please see the attached correspondence sent from the World Health
Organization, Regional Office for Europe. One or more attachments may be
included.Veuillez vous r¨¦f¨¦rer ¨¤ la correspondance ci-jointe du Bureau
r¨¦gional de l'Europe de l'Organisation mondiale de la sant¨¦. Une ou
plusieurs annexes peuvent ¨ºtre jointes.Mit der Bitte um Kenntnisnahme
der beiliegenden Korrespondenz (eine oder mehrere Anlagen),
Weltgesundheitsorganisation, Regionalb¨¹ro f¨¹r Europa.§³§Þ.
§á§â§Ú§Ü§â§Ö§á§Ý§Ö§ß§ß§í§Ö §á§Ú§ã§î§Þ§Ñ §à§ä §¦§Ó§â§à§á§Ö§Û§ã§Ü§à§Ô§à
§â§Ö§Ô§Ú§à§ß§Ñ§Ý§î§ß§à§Ô§à §Ò§ð§â§à §£§ã§Ö§Þ§Ú§â§ß§à§Û
§à§â§Ô§Ñ§ß§Ú§Ù§Ñ§è§Ú§Ú §Ù§Õ§â§Ñ§Ó§à§à§ç§â§Ñ§ß§Ö§ß§Ú§ñ (§à§Õ§Ú§ß §Ú§Ý§Ú
§ß§Ö§ã§Ü§à§Ý§î§Ü§à §á§â§Ú§Ü§â§Ö§á§Ý§Ö§ß§ß§í§ç §æ§Ñ§Û§Ý§à§Ó).