DCCast: Efficient Point to Multipoint Transfers Across Datacenters

Abstract

Using multiple datacenters allows for higher availability, load balancing and reduced latency to customers of cloud services. To distribute multiple copies of data, cloud providers depend on inter-datacenter WANs that ought to be used efficiently considering their limited capacity and the ever-increasing data demands. In this paper, we focus on applications that transfer objects from one datacenter to several datacenters over dedicated inter-datacenter networks. We present DCCast, a centralized Point to Multi-Point (P2MP) algorithm that uses forwarding trees to efficiently deliver an object from a source datacenter to required destination datacenters. With low computational overhead, DCCast selects forwarding trees that minimize bandwidth usage and balance load across all links. With simulation experiments on Google's GScale network, we show that DCCast can reduce total bandwidth usage and tail Transfer Completion Times (TCT) by up to $50\%$ compared to delivering the same objects via independent point-to-point (P2P) transfers.

Comment: 9th USENIX Workshop on Hot Topics in Cloud Computing, https://www.usenix.org/conference/hotcloud17/program/presentation/noormohammadpour

Document type: Conference object

Full document

Original document

The different versions of the original document can be found in:

• http://arxiv.org/abs/1707.02096

• http://arxiv.org/pdf/1707.02096

• http://dx.doi.org/10.31219/osf.io/fg2e5

• http://dx.doi.org/10.6084/m9.figshare.5873145 under the license https://creativecommons.org/licenses/by/4.0/legalcode

• http://dx.doi.org/10.6084/m9.figshare.5873145.v1 under the license https://creativecommons.org/licenses/by/4.0/legalcode

• https://zenodo.org/record/898830 under the license http://creativecommons.org/licenses/by/4.0/legalcode

• https://hal.archives-ouvertes.fr/hal-01819053,

https://hal.archives-ouvertes.fr/hal-01819053/document,

https://hal.archives-ouvertes.fr/hal-01819053/file/hotcloud17-paper-noormohammadpour.pdf

• https://osf.io/fg2e5,

http://dx.doi.org/10.17605/osf.io/fg2e5

• https://zenodo.org/record/898830,

http://dx.doi.org/10.5281/zenodo.898829 under the license https://creativecommons.org/licenses/by/4.0

• https://zenodo.org/record/898830,

http://dx.doi.org/10.5281/zenodo.898830 under the license https://creativecommons.org/licenses/by/4.0

DOIS: 10.6084/m9.figshare.5873145.v1 10.31219/osf.io/fg2e5 10.5281/zenodo.898829 10.6084/m9.figshare.5873145 10.17605/osf.io/fg2e5 10.5281/zenodo.898830 10.5281/zenodo.895705