Winner solution of mobile AI (CVPRW 2021).
-
Updated
May 14, 2022 - Python
#
int8-quantization
Here are 7 public repositories matching this topic...
FrostNet: Towards Quantization-Aware Network Architecture Search
computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network
-
Updated
May 3, 2024 - Python
Quantization Aware Training
-
Updated
Jan 13, 2024 - Python
将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。
-
Updated
Aug 17, 2022 - Python
Translation API using Meta's NLLB-200 model with 200+ languages
docker django docker-compose django-rest-framework celery redis-cache int8-quantization translationapi ctranslate2 nllb200
-
Updated
Dec 5, 2025 - Python
Hardware-aware optimization of CNN inference using INT8 quantization in PyTorch. Includes benchmarking, profiling, and visualization of accuracy, latency, and model size for edge deployment.
-
Updated
Jan 1, 2026 - Python
High-performance LLM inference platform with vLLM continuous batching achieving 12.3K+ req/sec, 42ms P50/178ms P99 latency, INT8/INT4 quantization (70% memory savings), tensor parallelism across 4 GPUs, and comprehensive monitoring serving 1500+ concurrent users.
-
Updated
Oct 3, 2025 - Python
Improve this page
Add a description, image, and links to the int8-quantization topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the int8-quantization topic, visit your repo's landing page and select "manage topics."