skip to main content
poster

Accelerating kubernetes with in-network caching

Published: 25 October 2022 Publication History
  • Get Citation Alerts
  • Abstract

    We present a new Kubernetes architecture that leverages in-network caching to accelerate one of Kubernetes' core components, its key-value store. We also identify performance limitations of previous in-network caching platforms and propose a new platform that demonstrates better throughput and scalability by utilising a different replication method.

    References

    [1]
    Prometheus Authors. 2022. Prometheus. Retrieved May 30, 2022 from https://prometheus.io/
    [2]
    The Kubernetes Authors. 2022. Kubernetes - Production-Grade Container Orchestration. Retrieved May 30, 2022 from https://kubernetes.io/
    [3]
    The Kubernetes Authors. 2022. Kubernetes Components. Retrieved May 30, 2022 from https://kubernetes.io/docs/concepts/overview/components/
    [4]
    Mininet Project Contributors. 2022. Mininet. Retrieved May 30, 2022 from http://mininet.org/
    [5]
    Intel Corporation. 2022. Intel Tofino. Retrieved May 30, 2022 from https://www.intel.co.uk/content/www/uk/en/products/network-io/programmable-ethernet-switch/tofino-series.html
    [6]
    The BMv2 Developers. 2022. BEHAVIORAL MODEL (bmv2). Retrieved May 30, 2022 from https://github.com/p4lang/behavioral-model
    [7]
    etcd Authors. 2022. etcd - A distributed, reliable key-value store for the most critical data of a distributed system. Retrieved May 30, 2022 from https://etcd.io/
    [8]
    Open Networking Foundation. 2022. P4 Open Source Programming Language. Retrieved May 30, 2022 from https://p4.org/
    [9]
    The P4.org Architecture Working Group. 2022. P416 Portable Switch Architecture (PSA). Retrieved May 30, 2022 from https://p4.org/p4-spec/docs/PSA-v1.1.0.html
    [10]
    The P4.org API Working Group. 2022. P4Runtime Specification. Retrieved May 30, 2022 from https://p4.org/p4-spec/p4runtime/main/P4Runtime-Spec.html
    [11]
    Andrew Jeffery, Heidi Howard, and Richard Mortier. 2021. Rearchitecting Kubernetes for the Edge. In Proceedings of the 4th International Workshop on Edge Systems, Analytics and Networking (Online, United Kingdom) (EdgeSys '21). Association for Computing Machinery, New York, NY, USA, 7--12.
    [12]
    Ricardo Jiménez-Peris, M. Patiño Martínez, Gustavo Alonso, and Bettina Kemme. 2003. Are Quorums an Alternative for Data Replication? ACM Trans. Database Syst. 28, 3 (sep 2003), 257--294.
    [13]
    Xin Jin, Xiaozhou Li, Haoyu Zhang, Nate Foster, Jeongkeun Lee, Robert Soulé, Changhoon Kim, and Ion Stoica. 2018. NetChain: Scale-Free Sub-RTT Coordination. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). USENIX Association, Renton, WA, 35--49. https://www.usenix.org/conference/nsdi18/presentation/jin
    [14]
    Networked Systems Group (NSG@ETH). 2022. P4-Utils. Retrieved May 30, 2022 from https://nsg-ethz.github.io/p4-utils/index.html
    [15]
    Amedeo Sapio, Marco Canini, Chen-Yu Ho, Jacob Nelson, Panos Kalnis, Changhoon Kim, Arvind Krishnamurthy, Masoud Moshref, Dan R. K. Ports, and Peter Richtárik. 2019. Scaling Distributed Machine Learning with In-Network Aggregation. CoRR abs/1903.06701 (2019). arXiv:1903.06701 http://arxiv.org/abs/1903.06701
    [16]
    Jeff Terrace and Michael J. Freedman. 2009. Object Storage on CRAQ: High-Throughput Chain Replication for Read-Mostly Workloads. In 2009 USENIX Annual Technical Conference (USENIX ATC 09). USENIX Association, San Diego, CA.
    [17]
    Inc. Tigera. 2022. Project Calico. Retrieved May 30, 2022 from https://www.tigera.io/project-calico/
    [18]
    Robbert van Renesse and Fred B. Schneider. 2004. Chain Replication for Supporting High Throughput and Availability. In 6th Symposium on Operating System Design and Implementation (OSDI 2004), San Francisco, California, USA, December 6--8, 2004, Eric A. Brewer and Peter Chen (Eds.). USENIX Association, 91--104. http://www.usenix.org/events/osdi04/tech/renesse.html

    Cited By

    View all
    • (2023)Seamless Hardware-Accelerated Kubernetes NetworkingProceedings of the 2nd ACM SIGCOMM Workshop on Future of Internet Routing & Addressing10.1145/3607504.3609292(23-28)Online publication date: 10-Sep-2023

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGCOMM '22: Proceedings of the SIGCOMM '22 Poster and Demo Sessions
    August 2022
    69 pages
    ISBN:9781450394345
    DOI:10.1145/3546037
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 October 2022

    Check for updates

    Author Tags

    1. P4
    2. data plane
    3. kubernetes
    4. replication

    Qualifiers

    • Poster

    Conference

    SIGCOMM '22
    Sponsor:
    SIGCOMM '22: ACM SIGCOMM 2022 Conference
    August 22 - 26, 2022
    Amsterdam, Netherlands

    Acceptance Rates

    Overall Acceptance Rate 554 of 3,547 submissions, 16%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)84
    • Downloads (Last 6 weeks)6

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Seamless Hardware-Accelerated Kubernetes NetworkingProceedings of the 2nd ACM SIGCOMM Workshop on Future of Internet Routing & Addressing10.1145/3607504.3609292(23-28)Online publication date: 10-Sep-2023

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media