The goal of the Metron. The services built by ULTRA will be an enabler for emerging applications such as intelligent transportation systems, the Internet of Things and e-health. To reduce tail latency of servers, and consolidate load to reduce costs and reduce the energy consumption, we built RSS++, an intra-server load balancer that is both load and state aware. Similarly, but with a very different approaches, we ensured a uniform load-balancing with Cheetah, while not breaking connections even when adding and removing servers., is to build internet services with ultra-low latency. We aim to make the Internet services work at the true speed of the underlying hardware, a bit of which started with
Our research project was all about creating fast software middleboxes, and more generally fast virtual network functions (VNFs). To handle middleboxes features like IDS, Firewall, DPI on a datacenter or near a core router, one has to use either multiple general purpose processors, or fast boxes mostly based on NPU or FPGA which are not really upgradable. Our goal is to come with a software architecture which would be able to handle very fast speed (~100Gbits/seconds) for any kind of VNFs on commodity hardware.
The first part of my work has been to find a strong basis for high speed I/O to build upon. We decided to use the Click Modular Router and extend it to do flow processing and use it as a “Click Modular Middlebox”. However, after some months we found that many things could be improved regarding the usage of underlying frameworks like DPDK and Netmap, usage of batching (both I/O and compute batching) and multi-queue, leading to a first ANCS 2015 paper. A year later, I did an internship at Cisco Meraki, where I tried techniques on their product, uncovering new problems and leading to new discoveries.
Since then, we extended FastClick to unify the classification, session mappings and stack services on behalf of the VNFs. This does not only lead to convenient services for VNFs developers, it also allows to minimize and factorize the classification, avoiding redundant operations across VMs. The stack allows for on-the-fly modification of any flow (such as HTTP or TCP flows), managing SEQs and ACKs on behalf of the user. A presentation poster has been accepted at EuroSys 2018. A subsequent invited paper has been presented at HPSR 2018. The codename of the implementation is MiddleClick.
To enable efficient usage of the infrastructure around the dataplane itself, I collaborated with people at the KTH Institute of Technology to come up with NSDI 2018.. Metron is a controller that enables to offload classification inside SDN switches and use NIC’s capabilities to directly deliver packets to the right FastClick process, avoiding any inter-core switch. “Metron: NFV Service Chains at the True Speed of the Underlying Hardware” waspresented at
After my PhD graduation I joined the NSLab team at KTH in July 2018, to work on Metron‘s next phase, towards a global, low-latency Internet.
In December 2019, we then published CoNEXT 2019. We observed the exponential growth of both Ethernet speeds and the number of CPU cores called for a new processing model for high-speed networking. Our new approach, RSS++, aims to answer the key question in this domain: which CPU core should get an incoming packet? RSS++ achieves very good load balancing over multiple CPU cores by exploiting opportunistic and controlled flow migration (utilizing a new design that enables lockless and zero-copy migration of state between CPU cores).at
After adressing the problem of intra-server load-balancing, it was natural to address inter-server load-balancing at NSDI 2020. We built , a new load balancer that solves the challenge of remembering which connection was sent to which server without the traditional trade off between uniform load balancing and efficiency. Cheetah is up to 5 times faster than stateful load balancers and can support advanced balancing mechanisms that reduce the flow completion time by a factor of 2 to 3x without breaking connections, even while adding and removing servers.
In our recentpaper to be presented at ASPLOS’21 in April we show the limits of current kernel bypass solutions such as DPDK and propose a new buffering model that has improved memory locality. Combined with a pipeline of source-to-source compilation and LLVM passes, the throughput increases by up to 70% for memory intensive network functions. While those improvements are generic, applied to FastClick it becomes the faster of all the open source packet processing frameworks publicly available. The extended abstract is already available.
- Alireza Farshin, Tom Barbette, Amir Roozbeh, Gerald Q. Maguire Jr, and Dejan Kostic ; PacketMill: Toward per-core 100-Gbps Networking ; ASPLOS’21 ; PacketMill ; Extended Abstract pre-available
- A High-Speed Load-Balancer Design with Guaranteed Per-Connection-Consistency ; Tom Barbette, Chen Tang, Haoran Yao, Dejan Kostić, Gerald Q. Maguire Jr., Panagiotis Papadimitratos, and Marco Chiesa ; NSDI’20 ; Cheetah
- RSS++: load and state-aware receive side scaling ; Tom Barbette, Georgios P. Katsikas, Gerald Q. Maguire Jr., and Dejan Kostić ; CoNEXT’19 ; RSS++ ; Video ; Slides
- Building a chain of high-speed VNFs in no time ; Tom Barbette, Cyril Soldani, Romain Gaillard and Laurent Mathy ; HPSR’18 (invited paper) ; MiddleClick
- Platform for programmable heterogeneous virtual middleboxes ; T Barbette ; PhD Thesis
- A low-level dive into building a high-speed NFV dataplane for service chaining ; T Barbette, C Soldani, R Gaillard, L Mathy ; EuroSys’18 Open Call Poster Session ; MiddleClick
- Metron: NFV Service Chains at the True Speed of the Underlying Hardware ; GP Katsikas, T Barbette, D Kostic, R Steinert, GQ Maguire Jr ; NSDI’18 ; Metron
- Fast userspace packet processing ;T Barbette, C Soldani, L Mathy ; ANCS’15 ; FastClick
- Implémentation d’un Système de Contrôle Domotique ; T Barbette ; Master Thesis