A sparsity-aware enterprise inferencing system for AI models on CPUs. Maximize your CPU infrastructure with DeepSparse to run performant computer vision (CV), natural language processing (NLP), and large language models (LLMs).
Features
- Optimized for sparse deep learning models
- Enables high-speed inference on CPUs
- Supports ONNX model format for broad compatibility
- Works with sparsified versions of popular deep learning models
- Scales from edge devices to cloud deployments
- Integrates with PyTorch and TensorFlow models
License
MIT LicenseFollow DeepSparse
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of DeepSparse!