Mary Kay O’Connor Process Safety Center, Texas A&M Energy Institute and Artie McFerrin Department of Chemical Engineering, Texas A&M University, College Station 77843, United States Article Views are ...
LLM Compressor is an easy-to-use and transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM. While using the LLM Compressor quantization ...