SplitRPC: A Control + Data Path Splitting RPC Stack for ML Inference Serving

Keyphrases

• Path Splitting 100%
• SmartNIC 100%
• Inference Serving 100%
• Control Data 100%
• Runtime Systems 66%
• Compiler 66%
• Network Interface Card 66%
• Machine Learning Models 66%
• Commodity Networks 66%
• Latency 33%
• Unified Approach 33%
• Hardware Accelerator 33%
• Execution Time 33%
• Accelerator-driven 33%
• GPU-based 33%
• Path Optimizing 33%
• Orchestration Capability 33%
• Transfer of Control 33%
• Distributed Setting 33%

Computer Science

• Network Interface Card 100%
• Runtime Systems 100%
• Compiler 100%
• Hardware Accelerator 50%
• Datapath 50%
• Execution Time 50%
• Graphics Processing Unit 50%
• Running Service 50%