Kapak Resmi

Splitwise: Collaborative Edge-Cloud Inference for LLMs via Lyapunov-Assisted DRL

Deploying large language models (LLMs) on edge devices is challenging due to their limited memory and power resources. Cloud-only inference reduces device burden but introduces high latency and cost. Static edge-cloud partitions optimize a single metric and struggle when bandwidth fluctuates. We pro...

Ful tanımlama

Kaydedildi:
Asıl Yazarlar: Younesi, Abolfazl, Maryan, Abbas Shabrang, Oustad, Elyas, Samani, Zahra Najafabadi, Ansari, Mohsen, Fahringer, Thomas
Materyal Türü: Makale
Baskı/Yayın Bilgisi: 2025
Konular:
Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
Emerging Technologies
Networking and Internet Architecture
68M14, 68T05, 68T07, 90C40
I.2.6; I.2.11; C.2.4; C.5.3
Online Erişim:https://arxiv.org/abs/2512.23310
http://arxiv.org/abs/2512.23310
Etiketler: Etiketle
Etiket eklenmemiş, İlk siz ekleyin!

Internet

https://arxiv.org/abs/2512.23310
http://arxiv.org/abs/2512.23310

Benzer Materyaller