算法地图

Allreduce算法地图

表1 Allreduce算法地图

算法序号

算法内容

1

Recursive

2

Node-aware Recursive+Binomial

3

Socket-aware Recursive+Binomial

4

Ring

5

Node-aware Recursive+K-nomial

6

Socket-aware Recursive+K-nomial

7

Node-aware K-nomial+K-nomial

8

Socket-aware K-nomial+K-nomial

12

Rabenseifner

13

Node-aware Rabenseifner

14

Socket-aware Rabenseifner

Bcast算法地图

表2 Bcast算法地图

算法序号

算法内容

1

Binomial tree

2

Node-aware Binomial+Binomial

3

Node-aware K-nomial+Binomial

4

Node-aware K-nomial+K-nomial

6

Ring

8

VanDeGeijn

10

Knomial tree

Barrier算法地图

表3 Barrier算法地图

算法序号

算法内容

1

Recursive

2

Node-aware Recursive+Binomial

3

Socket-aware Recursive+Binomial

4

Node-aware Recursive+K-nomial

5

Socket-aware Recursive+K-nomial

6

Node-aware K-nomial+K-nomial

7

Socket-aware K-nomial+K-nomial

Scatterv算法地图

表4 Scatterv算法地图

算法序号

算法内容

1

Linear

2

Knomial tree

Allgatherv算法地图

表5 Allgatherv算法地图

算法序号

算法内容

1

Neighbor exchange

2

Ring

3

Ring-HPL

4

Linear

5

Bruck