Research engineer at the Observatoire de Paris, in relation with the Paris Astronomical Data Center, with the mission to develop tools and standards for open data access. Author of the IVOA Provenance Data Model recommendation.
Practical Provenance in Astronomy
Recently the IVOA released a standard to structure provenance metadata and several implementations are in development in order to capture, store, access and visualize the provenance of astronomy data products. This BoF will be focused on practical needs for provenance in astronomy. A growing number of projects express the requirement to propose FAIR data (Findable, Accessible, Interoperable and Reusable) and thus manage provenance information to ensure the quality, reliability and trustworthiness of this data. The concepts are in place, but now, applied specifications and practical tools are needed to answer concrete use cases. We propose to discuss which strategies are considered by your projects (observatories or data providers) to capture provenance in your context and how you consider a end-user might query the provenance information to enhance her/his data selection and retrieval. The objective is to identify the development of tools and formats now needed to make provenance more practical.
If you are interested to participate in this BoF on provenance, please fill-in this questionnaire: https://frama.link/vqMBEqJg
This BoF is intended to be an open discussion. Except a short introduction, there will be no presentation, but you can find detailed presentations given in September during a provenance workshop within the ESCAPE European project, here is the summary (with access to all contributions): https://indico.in2p3.fr/event/21913/page/2641-summary
For more details on the IVOA Provenance Data Model, the recommendation is accessible here: https://www.ivoa.net/documents/ProvenanceDM
OPUS: an interoperable job control system based on VO standards
OPUS (Observatoire de Paris UWS System) is a job control system developed using the micro-framework bottle.py. The Universal Worker System pattern v1.1 (UWS) as defined by the International Virtual Observatory Alliance (IVOA) is implemented as a REST service to control job execution on a work cluster. OPUS also follows the recent IVOA Provenance Data Model recommendation to capture and expose the provenance information of jobs and results. By following well defined standards, the tool is interoperable and jobs can be run either through a web interface, or a script, and can be integrated to existing web platforms. Current instances are used in production by several projects at the Observatoire de Paris (CTA/H.E.S.S, MASER, ComPOSE).