See the latest Release Notes.
nGraph is an open-source C++ library, compiler stack, and runtime accelerator for software and neural network engineering within the Deep Learning ecosystem. nGraph simplifies development and makes it possible to design, write, compile, and deploy Deep Neural Network-based solutions that can be adapted and deployed across many frameworks and backends. See our project Architecture, Features, FAQs and ecosystem for more details.
We have many documentation pages to help you get started.
TensorFlow or MXNet users can get started with Integrate Supported Frameworks.
Note that the
pippackage option works only with Ubuntu 16.04 or greater and Intel® Xeon® CPUs. CPUs without Intel® Advanced Vector Extensions 512 (Intel® AVX-512) will not run these packages; the alternative is to build from source. Wider support for other CPUs will be offered starting in early 2019.
Framework authors and architects will likely want to Build the C++ Library and learn how nGraph can be used to Execute a computation. For examples of generic configurations or optimizations available when designing or bridging a framework directly with nGraph, see Connecting Frameworks.
To start learning about nGraph’s set of Core ops and how they can be used with Ops from other frameworks, go to List of Core ops.
For details about PlaidML integration and other nGraph runtime APIs, see the section Interact with Backends.
|Framework||Bridge Available?||ONNX Support?|
|Other||Write your own||Custom|
|Backend||Current support||Future nGraph support|
|Intel® Architecture Processors (CPUs)||Yes||Yes|
|Intel® Nervana™ Neural Network Processor (NNPs)||Yes||Yes|
|Intel® Architecture GPUs||Yes||Yes|
|AMD* GPUs||via PlaidML||Yes|
|Field Programmable Gate Arrays (FPGAs)||Coming soon||Yes|
|NVIDIA* GPUs||via PlaidML||Some|
|Intel Movidius™ Myriad™ 2 (VPU)||Coming soon||Yes|
The code in this repo is under active development as we’re continually adding support for more kinds of DL models and ops, compiler optimizations, and backend optimizations.