AllReduce

AllReduce // Collective operation

Description

Combines values from all processes or devices and distributes the result back to all processes or devices.

Inputs

Name Element Type Shape
arg element::f32 element::f64 Any

Outputs

Name Element Type Shape
output element::f32 element::f64 Same as arg

C++ Interface

class AllReduce : public ngraph::op::Op

Public Functions

const std::string &description() const

Get the string name for the type of the node, such as Add or Multiply. The class name, must not contain spaces as it is used for codegen.

Return
A const reference to the node’s type name

void validate_and_infer_types()

Throws if the node is invalid.