Skip to content
MukhyamantriMukhyamantri
Technology

zse-engine added to PyPI

Zero-dependency LLM inference engine. Fastest cold start, smallest VRAM footprint. CUDA + ROCm + Metal.

By [email protected]· Pypi.org· 5 months ago· 2 min read
zse-engine added to PyPI

Zero-dependency LLM inference engine. Fastest cold start, smallest VRAM footprint. CUDA + ROCm + Metal. For the full story, visit the source.

This summary is sourced from Pypi.org. Read the full article at:Pypi.org
#Inference#Llm#Machine Learning#Pytorch