A robust technique to transform time series with missing data into a zero mean series
dc.contributor.author | Adikaram, K.K.L.B. | |
dc.contributor.author | Jayantha, P.A. | |
dc.date.accessioned | 2024-12-18T09:56:15Z | |
dc.date.available | 2024-12-18T09:56:15Z | |
dc.date.issued | 2016-11-05 | |
dc.description.abstract | In the process of knowledge mining, feature scaling plays a crucial role. For feature scaling, there are two widely used methods in many machine learning algorithms, namely, mean normalization and standardization. In both these methods, mean is zero and consider only the dependent variable (y); no involvement of independent variable (x). Thus, regardless of the original regression, those approaches treat all the data as y = c series. However, when some data points are missing or removed (as outliers), the said approaches destroy the original regression. In this research, a novel standardization method to standardize data based on linear regression (y = mx + c) was introduced. The proposed transformation was given by ʸⁿᵉʷ ⁼ ʸᵀ ⁻ ᵡ ˣ ʸᵀ / ᵡᵀ+ c where ʸᵀ = ʸ ⁻ ʸᵣ, ᵡᵀ = ᵡ ⁻ ᵡᵣ, (ᵡᵣ,ʸᵣ) is any selected reference point, and c is any constant. The speciality of the proposed method is that the transformation used both independent and dependent variables. Thus, no influences form missing or removed data. When there were no noise or outliers, the new method transformed data into a y = c series even with multiple missing values. When c = 0, results showed that the transformation produces a zero mean series from any data set even with noise, outliers and missing values. | |
dc.identifier.citation | Proceedings of the Peradeniya University International Research Sessions (iPURSE) – 2016, University of Peradeniya, P 291 | |
dc.identifier.isbn | 978-955-589-225-4 | |
dc.identifier.uri | https://ir.lib.pdn.ac.lk/handle/20.500.14444/5014 | |
dc.language.iso | en_US | |
dc.publisher | University of Peradeniya, Sri Lanka | |
dc.subject | Robust technique | |
dc.subject | Data | |
dc.subject | Zero mean series | |
dc.title | A robust technique to transform time series with missing data into a zero mean series | |
dc.type | Article |