HyperLoom


== Abstract ==

Real-world scientific applications often encompass end-to-end data processing pipelines composed of a large number of interconnected computational tasks of various granularity. We introduce HyperLoom, an open source platform for defining and executing such pipelines in distributed environments and providing a Python interface for defining tasks. HyperLoom is a self-contained system that does not use an external scheduler for the actual execution of the task. We have successfully employed HyperLoom for executing chemogenomics pipelines used in pharmaceutic industry for novel drug discovery. 6 1


== Original document ==

The different versions of the original document can be found in:

* [http://dspace.vsb.cz/bitstream/10084/133294/2/2018p1.pdf http://dspace.vsb.cz/bitstream/10084/133294/2/2018p1.pdf]

* [http://dx.doi.org/10.1145/3183767.3183768 http://dx.doi.org/10.1145/3183767.3183768] under the license http://www.acm.org/publications/policies/copyright_policy#Background

* [http://hdl.handle.net/10084/133294 http://hdl.handle.net/10084/133294]

* [http://dl.acm.org/ft_gateway.cfm?id=3183768&ftid=1952872&dwn=1 http://dl.acm.org/ft_gateway.cfm?id=3183768&ftid=1952872&dwn=1],
: [http://dx.doi.org/10.1145/3183767.3183768 http://dx.doi.org/10.1145/3183767.3183768] under the license http://www.acm.org/publications/policies/copyright_policy#Background

* [https://dblp.uni-trier.de/db/conf/hipeac/parma2018.html#CimaBMDJAAC18 https://dblp.uni-trier.de/db/conf/hipeac/parma2018.html#CimaBMDJAAC18],
: [https://dl.acm.org/citation.cfm?doid=3183767.3183768 https://dl.acm.org/citation.cfm?doid=3183767.3183768],
: [https://dspace.vsb.cz/handle/10084/133294 https://dspace.vsb.cz/handle/10084/133294],
: [https://academic.microsoft.com/#/detail/2790801434 https://academic.microsoft.com/#/detail/2790801434]