An automated pipeline for the VST data log analysis

Every night the VST Telescope Control Software logs information about the telescope and instrument operations, executed commands, failures, weather conditions and anything relevant for the instrument maintenance and the identification of problem sources. All this information is recorded in text files and stored in a large archive. Individual files are often examined by the observatory personnel for specific issues and for solving well identified problems raised during the night, in the framework of dedicated and focused efforts. Thus, only a minimal part of the information is useful for this kind of daily maintenance.
Nevertheless, the analysis of the archived information collected over a long time span can be exploited to reveal useful trends and statistics about the telescope, which would otherwise be overlooked. Given the large size of the archive, a manual inspection and handling of the logs is cumbersome. An automated tool with an adequate user interface has been developed to scrape specific entries within the log files, process the data and display it in a comprehensible way. This pipeline has been used to scan the information collected over 5 years of telescope activity.


Theme – Data Processing Pipelines and Science-Ready Data, Other