CPU Inference Performance Boost with “Throughput” Mode in the Intel Distribution of OpenVINO Toolkit
This blog post was originally published at Intel's website. It is reprinted here with the permission of Intel. One of the biggest challenges to AI can be eliciting high-performance deep learning inference that runs at real-world scale, leveraging existing infrastructures. Combining efficiency and flexibility, the Intel® Distribution of OpenVINO™ toolkit (a developer tool suite that […]