AllReduce // Collective operation


Combines values from all processes or devices and distributes the result back to all processes or devices.


Name Element Type Shape
arg element::f32 element::f64 Any


Name Element Type Shape
output element::f32 element::f64 Same as arg

C++ Interface

class AllReduce : public ngraph::op::Op

Public Functions

const NodeTypeInfo &get_type_info() const

Returns the NodeTypeInfo for the node’s class. During transition to type_info, returns a dummy type_info for Node if the class has not been updated yet.

void validate_and_infer_types()

Throws if the node is invalid.