G. Bruce Berriman
Bruce Berriman is a Senior Scientist at Caltech/IPAC-NExScI. He is the head of the Keck Observatory Archive, the Vice-Chair of the IVOA Executive Committee, and system engineer for the Keck Planet Finder reduction pipeline. He has long had an interest in applying Cloud Computing to astronomy applications, and is the author of the forthcoming IOP-AAS eBook "Cloud Computing in Astronomy."
Cost Management on Commercial Cloud Platforms
Commercial cloud platforms are a powerful technology for astronomical research. The Event Horizon Telescope has processed much of its raw data on cloud platforms (Akiyama et al. 2019 - ApJL 875, L1; Kim et al. 2020; A & A, 640, A69 ) The Ice Cube neutrino experiment recently performed a similation experiment with 15,000 GPUs on three cloud platforms. Despite the benefits of cloud computing - such as on-demand scalability, and reduction of systems management overhead - confusion over how to manage costs remains for many one of the biggest barriers to entry, exacerbated by the rapid growth in services offered by commercial providers, and by the growth in the number of these providers. The confuses arises because storage, compute, and I/O are metered at separate rates, all of which can change without notice. As a rule, processing is very cheap, storage is more expensive, and downloading is very expensive. Thus an application that produces large image data sets for download will be far more expensive than an application that performs extensive processing on a small data set.
This BoF aims to quantify the above statement by presenting case studies of the costing of astronomy applications on commercal clouds, covering a range of processing scenarios, including:
- Hosting the Rubin Observatory Interim Data Facility on a cloud platform.
- Creating an all-sky mosaic of TESS survey images.
- Summary of a cost management workshop at IPAC.
- Launching Sci Server on a cloud platform.
- Managing cloud services at STScI
Discussion of these and other cases are intended to answer the address the following questions:
- What are the best practices that I can employ for estimating costs?
- How do I pick the best platform for my application?
- How do I take advantage of free or reduced costs services (educators or researchers credits; spot pricing; use an academic cloud...)?
- What are the best practices for optimizing performance and reducing my costs?
- What are the fiscal "black holes" that I can fall into?
- Where can I find all this information?
Organizers: Bruce Berriman (Caltech/IPAC-NExScI); Gerard Lemson (JHU); William O'Mullane (Rubin Observatory); Ivelina Momcheva (STScI); Andreas Wicenic (ICRAR).
How to better describe software for discovery and citation
In this BoF we propose to discuss a variety of items to improve how
software is described and can be discovered. We will invite and
actively search for contributions to this discussion. Some examples of
what we could cover:
The codemeta.json file, under control of software
authors. Including a working session to write your own (or base it on
the ASCL starter file). This file (or itâs cousin
CITATION.cff) will also improve software citation, and we will explain
Possible options to expand the codemeta file, e.g. keywords
describing the API and its one-liners.
Improvements to the Unified Astronomy Thesaurus (UAT) such that
software is better covered.
Define a well defined field in astrophysics and take an inventory
of the software used to categorize them. A conference would be an
ideal event to get all the stakeholders together (we have a candidate
We encourage contributions to this BoF.
The International Virtual Observatory Alliance (IVOA) in 2020
The International Virtual Observatory Alliance (IVOA) develops the technical standards needed for seamless discovery and access to astronomy data worldwide, according to the FAIR principles, with the goal of realizing the Virtual Observatory (VO). There are 22 member organizations. The newest member, Netherlands VO, joined in 2020. More astronomical communities from other nations have shown their interest in joining into the IVOA. This poster describes the activities of the IVOA in 2020, summarizes the May 2020 "interoperability meeting" and previews the November 2020 interoperability meeting that follows ADASS. The May meeting was the first held on-line, and was the first to have over 200 registrants. In particular, the poster will discuss IVOA engagement in global initiatives, including support for the IAU's Office of Astronomy for Development in remote teaching and learning program, and a CODATA initiative on standardizing global units of measure.
This poster is presented on behalf of the IVOA community.