Ajou University repository

Decentralized message broker federation architecture with multiple DHT rings for high survivability
  • Kim, Minsub ;
  • Bae, Minho ;
  • Yeo, Sangho ;
  • Park, Gyudong ;
  • Oh, Sangyoon
Citations

SCOPUS

0

Citation Export

Publication Year
2018-01-01
Journal
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher
Springer Verlag
Citation
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol.10964 LNCS, pp.218-226
Keyword
Coordination schemeDistributed hash tableMessage broker federation
Mesh Keyword
Coordination schemeDistributed clustersDistributed Hash TableInformation providerMessage brokersMessaging servicesMessaging systemProposed architectures
All Science Classification Codes (ASJC)
Theoretical Computer ScienceComputer Science (all)
Abstract
A message broker is an essential component of messaging services that connect information providers and consumers, message service clients, to enable the integrated message network. To support large scale message clients with the contracted service level, multiple brokers have to collaborate and form a federated broker cluster in many cases. For example, Kafka is one of the most popular messaging systems that allows multiple brokers co-working together. ZooKeeper, the distributed cluster coordinator, manages cluster nodes and stores metadata of messages for Kafka. Even though ZooKeeper does the coordination job well in a simple way, its half-centralized coordinating methods make the overall system less capable in survivability. In some domains such as military warfare and embedded sensor networks, we may lose the primary coordinator or lose more than a half of the coordinator machines. In these cases, we cannot support the minimum survivability to maintain the message network. To address this limited survivability problem, we propose a decentralized message broker federation architecture with distributed hash table. In our proposed architecture design, the decentralized coordinator supports the DHT exchanges between brokers to manage metadata of distributed message partitions. We built a prototype of a message broker federation based on our proposed decentralized metadata coordinator design to show the feasibility in terms of practical application.
Language
eng
URI
https://aurora.ajou.ac.kr/handle/2018.oak/36244
https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85049952105&origin=inward
DOI
https://doi.org/10.1007/978-3-319-95174-4_18
Journal URL
https://www.springer.com/series/558
Type
Conference
Funding
Acknowledgement. This research is supported by C2 integrating and interfacing technologies laboratory of Agency for Defense Development (UD180010ED).
Show full item record

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Oh, Sangyoon Image
Oh, Sangyoon오상윤
Department of Software and Computer Engineering
Read More

Total Views & Downloads

File Download

  • There are no files associated with this item.