Metron: Holistic Performance Evaluation Framework for LLM Inference Systems

Arxiv Papers - Metron: Holistic Performance Evaluation Framework for LLM Inference Systems