A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes - Télécom Paris Access content directly
Preprints, Working Papers, ... Year :

A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes

Sheng Yang
Xiaohu Tang
  • Function : Author
  • PersonId : 1054135

Abstract

The optimal storage-computation tradeoff is characterized for a MapReduce-like distributed computing system with straggling nodes, where only a part of the nodes can be utilized to compute the desired output functions. The result holds for arbitrary output functions and thus generalizes previous results that restricted to linear functions. Specifically, in this work, we propose a new information-theoretical converse and a new matching coded computing scheme, that we call coded computing for straggling systems (CCS).
Fichier principal
Vignette du fichier
CCS_ISIT.pdf (360.04 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02288594 , version 1 (15-09-2019)

Identifiers

  • HAL Id : hal-02288594 , version 1

Cite

Qifa Yan, Michèle Wigger, Sheng Yang, Xiaohu Tang. A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes. 2019. ⟨hal-02288594⟩
56 View
116 Download

Share

Gmail Facebook Twitter LinkedIn More