OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference.
This open-source version includes several components: namely OpenVINO Model Converter (OVC), OpenVINO™ Runtime, as well as CPU, GPU, multi device and heterogeneous plugins to accelerate deep learning inference on Intel® CPUs and Intel® Processor Graphics. It supports pre-trained models from Open Model Zoo, along with 100+ open source and public models in popular formats such as TensorFlow, ONNX, PaddlePaddle, MXNet, Caffe, Kaldi.
The OpenVINO™ Runtime can infer models on different hardware devices. This section provides the list of supported devices.
Device | Plugin | Library | Short Description |
---|---|---|---|
CPU | Intel CPU | openvino_intel_cpu_plugin | Intel Xeon with Intel® Advanced Vector Extensions 2 (Intel® AVX2), Intel® Advanced Vector Extensions 512 (Intel® AVX-512), and AVX512_BF16, Intel Core Processors with Intel AVX2, Intel Atom Processors with Intel® Streaming SIMD Extensions (Intel® SSE), Intel® Advanced Matrix Extensions (Intel® AMX) |
ARM CPU | openvino_arm_cpu_plugin | Raspberry Pi™ 4 Model B, Apple® Mac mini with Apple silicon | |
GPU | Intel GPU | openvino_intel_gpu_plugin | Intel Processor Graphics, including Intel HD Graphics and Intel Iris Graphics |
OpenVINO™ Toolkit also contains several plugins which simplify loading models on several hardware devices:
Plugin | Library | Short Description |
---|---|---|
Auto | openvino_auto_plugin | Auto plugin enables selecting Intel device for inference automatically |
Auto Batch | openvino_auto_batch_plugin | Auto batch plugin performs on-the-fly automatic batching (i.e. grouping inference requests together) to improve device utilization, with no programming effort from the user |
Hetero | openvino_hetero_plugin | Heterogeneous execution enables automatic inference splitting between several devices |
Multi | openvino_auto_plugin | Multi plugin enables simultaneous inference of the same model on several devices in parallel |
OpenVINO™ Toolkit is licensed under Apache License Version 2.0. By contributing to the project, you agree to the license and copyright terms therein and release your contribution under these terms.
OpenVINO™ collects software performance and usage data for the purpose of improving OpenVINO™ tools. This data is collected directly by OpenVINO™ or through the use of Google Analytics 4. You can opt-out at any time by running the command:
opt_in_out --opt_out
More Information is available at https://docs.openvino.ai/latest/openvino_docs_telemetry_information.html.
The latest documentation for OpenVINO™ Toolkit is available here. This documentation contains detailed information about all OpenVINO components and provides all the important information you may need to create an application based on binary OpenVINO distribution or own OpenVINO version without source code modification.
Developer documentation contains information about architectural decisions which are applied inside the OpenVINO components. This documentation has all necessary information which could be needed in order to contribute to OpenVINO.
The list of OpenVINO tutorials:
You can also check out Awesome OpenVINO to see all the community-made projects using OpenVINO!
The system requirements vary depending on platform and are available on dedicated pages:
See How to build OpenVINO to get more information about the OpenVINO build process.
See Contributions Welcome for good first issues.
See CONTRIBUTING for contribution details. Thank you!
Visit Intel DevHub Discord server if you need help or wish to talk to OpenVINO developers. You can go to the channel dedicated to Good First Issue support if you are working on a task.
If you wish to be assigned to an issue please add a comment with .take
command.
Report questions, issues and suggestions, using:
openvino
tag on StackOverflow** Other names and brands may be claimed as the property of others.