Decentralized Edge-to-Cloud Load-balancing: Service Placement for the Internet of Things

Bibliographic Details
Title: Decentralized Edge-to-Cloud Load-balancing: Service Placement for the Internet of Things
Authors: Nezami, Zeinab, Zamanifar, Kamran, Djemame, Karim, Pournaras, Evangelos
Publication Year: 2020
Collection: Computer Science
Subject Terms: Computer Science - Distributed, Parallel, and Cluster Computing
More Details: The Internet of Things (IoT) requires a new processing paradigm that inherits the scalability of the cloud while minimizing network latency using resources closer to the network edge. Building up such flexibility within the edge-to-cloud continuum consisting of a distributed networked ecosystem of heterogeneous computing resources is challenging. Furthermore, IoT traffic dynamics and the rising demand for low-latency services foster the need for minimizing the response time and balanced service placement. Load-balancing for fog computing becomes a cornerstone for cost-effective system management and operations. This paper studies two optimization objectives and formulates a decentralized load-balancing problem for IoT service placement: (global) IoT workload balance and (local) quality of service (QoS), in terms of minimizing the cost of deadline violation, service deployment, and unhosted services. The proposed solution, EPOS Fog, introduces a decentralized multi-agent system for collective learning that utilizes edge-to-cloud nodes to jointly balance the input workload across the network and minimize the costs involved in service execution. The agents locally generate possible assignments of requests to resources and then cooperatively select an assignment such that their combination maximizes edge utilization while minimizes service execution cost. Extensive experimental evaluation with realistic Google cluster workloads on various networks demonstrates the superior performance of EPOS Fog in terms of workload balance and QoS, compared to approaches such as First Fit and exclusively Cloud-based. The results confirm that EPOS Fog reduces service execution delay up to 25% and the load-balance of network nodes up to 90%. The findings also demonstrate how distributed computational resources on the edge can be utilized more cost-effectively by harvesting collective intelligence.
Comment: 17 pages and 15 figures
Document Type: Working Paper
DOI: 10.1109/ACCESS.2021.3074962
Access URL: http://arxiv.org/abs/2005.00270
Accession Number: edsarx.2005.00270
Database: arXiv
FullText Text:
  Availability: 0
CustomLinks:
  – Url: http://arxiv.org/abs/2005.00270
    Name: EDS - Arxiv
    Category: fullText
    Text: View this record from Arxiv
    MouseOverText: View this record from Arxiv
  – Url: https://resolver.ebsco.com/c/xy5jbn/result?sid=EBSCO:edsarx&genre=article&issn=&ISBN=&volume=&issue=&date=20200501&spage=&pages=&title=Decentralized Edge-to-Cloud Load-balancing: Service Placement for the Internet of Things&atitle=Decentralized%20Edge-to-Cloud%20Load-balancing%3A%20Service%20Placement%20for%20the%20Internet%20of%20Things&aulast=Nezami%2C%20Zeinab&id=DOI:10.1109/ACCESS.2021.3074962
    Name: Full Text Finder (for New FTF UI) (s8985755)
    Category: fullText
    Text: Find It @ SCU Libraries
    MouseOverText: Find It @ SCU Libraries
Header DbId: edsarx
DbLabel: arXiv
An: edsarx.2005.00270
RelevancyScore: 1008
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 1007.66955566406
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Decentralized Edge-to-Cloud Load-balancing: Service Placement for the Internet of Things
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Nezami%2C+Zeinab%22">Nezami, Zeinab</searchLink><br /><searchLink fieldCode="AR" term="%22Zamanifar%2C+Kamran%22">Zamanifar, Kamran</searchLink><br /><searchLink fieldCode="AR" term="%22Djemame%2C+Karim%22">Djemame, Karim</searchLink><br /><searchLink fieldCode="AR" term="%22Pournaras%2C+Evangelos%22">Pournaras, Evangelos</searchLink>
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2020
– Name: Subset
  Label: Collection
  Group: HoldingsInfo
  Data: Computer Science
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+-+Distributed%2C+Parallel%2C+and+Cluster+Computing%22">Computer Science - Distributed, Parallel, and Cluster Computing</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: The Internet of Things (IoT) requires a new processing paradigm that inherits the scalability of the cloud while minimizing network latency using resources closer to the network edge. Building up such flexibility within the edge-to-cloud continuum consisting of a distributed networked ecosystem of heterogeneous computing resources is challenging. Furthermore, IoT traffic dynamics and the rising demand for low-latency services foster the need for minimizing the response time and balanced service placement. Load-balancing for fog computing becomes a cornerstone for cost-effective system management and operations. This paper studies two optimization objectives and formulates a decentralized load-balancing problem for IoT service placement: (global) IoT workload balance and (local) quality of service (QoS), in terms of minimizing the cost of deadline violation, service deployment, and unhosted services. The proposed solution, EPOS Fog, introduces a decentralized multi-agent system for collective learning that utilizes edge-to-cloud nodes to jointly balance the input workload across the network and minimize the costs involved in service execution. The agents locally generate possible assignments of requests to resources and then cooperatively select an assignment such that their combination maximizes edge utilization while minimizes service execution cost. Extensive experimental evaluation with realistic Google cluster workloads on various networks demonstrates the superior performance of EPOS Fog in terms of workload balance and QoS, compared to approaches such as First Fit and exclusively Cloud-based. The results confirm that EPOS Fog reduces service execution delay up to 25% and the load-balance of network nodes up to 90%. The findings also demonstrate how distributed computational resources on the edge can be utilized more cost-effectively by harvesting collective intelligence.<br />Comment: 17 pages and 15 figures
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Working Paper
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1109/ACCESS.2021.3074962
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="http://arxiv.org/abs/2005.00270" linkWindow="_blank">http://arxiv.org/abs/2005.00270</link>
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsarx.2005.00270
PLink https://login.libproxy.scu.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsarx&AN=edsarx.2005.00270
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/ACCESS.2021.3074962
    Subjects:
      – SubjectFull: Computer Science - Distributed, Parallel, and Cluster Computing
        Type: general
    Titles:
      – TitleFull: Decentralized Edge-to-Cloud Load-balancing: Service Placement for the Internet of Things
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Nezami, Zeinab
      – PersonEntity:
          Name:
            NameFull: Zamanifar, Kamran
      – PersonEntity:
          Name:
            NameFull: Djemame, Karim
      – PersonEntity:
          Name:
            NameFull: Pournaras, Evangelos
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Type: published
              Y: 2020
ResultId 1