Development, deployment, and testing of Jupyter notebooks at Astro Data Lab

Astro Data Lab is an open-data / open-access astronomical science platform built and operated at NSF's National Optical-Infrared Astronomy Research Laboratory's (NOIRLab) Community Science and Data Center (CSDC). It provides free access to hundreds of Terabytes of astronomical survey catalogs and over 2 Petabytes of associated images, paired with co-located compute resources. The main access mode is through Jupyter notebooks, using IVOA protocols and Data Lab APIs. Our poster describes how a Data Lab curated notebook is born and maintained with source control on GitHub (often in collaboration with users), how we deploy it to our servers using webhooks, how it is launched at scale on our notebook server, and how we test our entire notebook suite using nbconvert and a custom workflow.

Theme – Science Platforms and Data Lakes