LLMCompass: Enabling Efficient Hardware Design for Large Language Model Inference

Authors: Zhang, Hengrui, Ning, August, Prabhakar, Rohan Baskar, Wentzlaff, David

Source: 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA) ISCA Computer Architecture (ISCA), 2024 ACM/IEEE 51st Annual International Symposium on. :1080-1096 Jun, 2024

Relation: 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)

Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference

Authors: Prabhakar, Rohan Baskar, Zhang, Hengrui, Wentzlaff, David

Subject Terms: Computer Science - Machine Learning, Computer Science - Distributed, Parallel, and Cluster Computing

Access URL: http://arxiv.org/abs/2408.07802