StarDock: shipping customized computing environments to the data

Abstract

Surging data volumes make it increasingly unfeasible to transfer astronomical datasets to the local systems of individual scientists. Centralized pipelines offer some relief, but lack flexibility to fulfill the needs of all users. We have developed a system that leverages the Docker container application virtualization software. Along with a suite of commonly used astronomy applications, users can configure a container with their own custom software and analysis tools. Our StarDock system will move the users container to the data, and expose the requested dataset, allowing our users to safely and securely process their data without needlessly transferring hundreds of gigabytes.

Original document

The different versions of the original document can be found in:

• http://dx.doi.org/10.1117/12.2233081 under the license https://creativecommons.org/licenses/by

• https://scholarworks.iu.edu/dspace/bitstream/2022/20961/1/991318.pdf

• https://ui.adsabs.harvard.edu/abs/2016SPIE.9913E..18Y/abstract,

https://www.spiedigitallibrary.org/conference-proceedings-of-spie/9913/991318/StarDock-shipping-customized-computing-environments-to-the-data/10.1117/12.2233081.full,

https://academic.microsoft.com/#/detail/2500164068 under the license cc-by