Main content

ATQ: Alarm time quality, an evaluation metric for assessing timely epidemic detection models within a school absenteeism-based surveillance system

Show full item record

Title: ATQ: Alarm time quality, an evaluation metric for assessing timely epidemic detection models within a school absenteeism-based surveillance system
Author: Vanderkruk, Kayla
Department: Department of Mathematics and Statistics
Program: Mathematics and Statistics
Advisor: Feng, ZenyDeeth, Lorna
Abstract: Model-based school absenteeism surveillance systems have been proposed to raise seasonal influenza epidemic alarms. Previous studies used metrics such as false alarm rate (FAR) and accumulated days delayed, for model evaluation and selection, however they were unable to optimize both alarm accuracy and timeliness. In this study, we developed a metric, alarm time quality (ATQ), that simultaneously evaluated both aspects by assessing alarms on a gradient, where alarms raised incrementally before or after an optimal time were informative, but penalized. Summary statistics of ATQ, average alarm time quality (AATQ) and first alarm time quality (FATQ), were used as model selection criterion. Alarms raised by ATQ and FAR-selected logistic regression models were compared. Daily school absenteeism and laboratory-confirmed influenza data collected by Wellington-Dufferin-Guelph Public Health was used for demonstration. A simulation study representative of Wellington-Dufferin-Guelph was conducted for further evaluation. ATQ-selected models were found to raise alarms that were timelier than the FAR-selected model.
URI: https://hdl.handle.net/10214/25763
Date: 2021-04-26
Terms of Use: All items in the Atrium are protected by copyright with all rights reserved unless otherwise indicated.
Embargoed Until: 2022-04-25


Files in this item

Files Size Format View
Vanderkruk_Kayla_202105_MSc.pdfuntranslated 379.8Kb PDF View/Open

This item appears in the following Collection(s)

Show full item record