Master's Thesis

Autonomous time series data processing on historical and real-time settings

Ricardo Filipe Lourenço Nunes de Sousa — 2021

Key information

Authors:

Ricardo Filipe Lourenço Nunes de Sousa (Ricardo Filipe Lourenço Nunes de Sousa)

Supervisors:

Rui Miguel Carrasqueiro Henriques (Rui Miguel Carrasqueiro Henriques); Maria da Conceição Esperança Amado (Maria da Conceição Esperança Amado)

Published in

January 20, 2021

Abstract

Heterogeneous sensor networks, including water distribution systems and traffic monitoring systems, produce abundant time series data with an arbitrarily-high multivariate order for monitoring network dynamics and detecting events of interest. Nevertheless, errors and failures in the calibration, data storage or acquisition can occur on some of the sensors installed in those systems, producing missing and/or anomalous values. This thesis proposes a computational system, for the fully autonomous cleaning of multivariate time series data using strict quality criteria assessed against ground truth extracted from the targeted series data, on historical and real time data contexts. The proposed methodology is parameterfree as it relies on robust principles for the assessment, hyperparameterization and selection of methods. This work supports an extensive set state-of-the-art methods for (multivariate) time series imputation and outlier detection-and-treatment, considering both point and segment/serial occurrences. A comprehensive evaluation of system is accomplished using heterogeneous sensors from two water distribution systems with varying sampling rates, water consumption patterns, and inconsistencies. Results confirm the relevance of the proposed autonomous processing approach, and its extensibility towards real-time settings under tigtht optimality guarantees.

Publication details

Authors in the community:

Supervisors of this institution:

Fields of Science and Technology (FOS)

electrical-engineering-electronic-engineering-information-engineering - Electrical engineering, electronic engineering, information engineering

Publication language (ISO code)

eng - English

Rights type:

Embargo lifted

Date available:

November 26, 2021

Institution name

Instituto Superior Técnico