Preprint / Version 2

Modeling Information Blackouts in Missing Not-At-Random Time Series

A State-Space Approach Using Missingness as Signal

##article.authors##

DOI:

https://doi.org/10.31224/6180

Keywords:

missing not at random, MNAR, missing data, sensor blackouts, traffic sensors, time series, state-space models, linear dynamical systems, Kalman filter, RTS smoother, expectation-maximization, imputation, forecasting, probabilistic modeling, transportation systems, Allan Ma

Abstract

Traffic sensor networks frequently experience “blackouts,” i.e., contiguous intervals of missing observations. This preprint evaluates two tasks: (1) blackout imputation (reconstructing values inside blackout windows) and (2) post-blackout forecasting at horizons +1, +3, and +6 steps on a 5-minute grid. We compare a MAR linear dynamical system (Kalman filtering with RTS smoothing) against an MNAR extension that treats the missingness mask as an informative observation channel via a logistic missingness model conditioned on the latent state. The repository includes code, evaluation-window manifests, and notebooks for experiments on the Seattle Loop dataset and the METR-LA dataset.

 

Downloads

Download data is not yet available.

Author Biographies

Aman Sunesh, New York University

 

 

Allan Ma, New York University

 

 

Siddarth Nilol

 

 

Downloads

Posted

2026-01-05 — Updated on 2026-01-06

Versions

Version justification

Missing Legend