Feature Scope
Data Types
Supported data types are as follows. The src and dst data types must be the same.
Propagation Direction |
src Data Type |
dst Data Type |
|---|---|---|
FWD_D, BWD_D |
f32 |
f32 |
f16 |
f16 |
|
bf16 |
bf16 |
|
s32 |
s32 |
|
s8 |
s8 |
|
u8 |
u8 |
Data Layout
1D to 5D tensors are supported. The following data layout formats are supported. The layout of input and output tensors must be the same.
Tensor Dimension |
src Data Layout |
dst Data Layout |
|---|---|---|
1D |
a |
a |
2D |
ab,ba |
ab,ba |
3D |
abc,acb,bac,bca,cab,cba |
abc,acb,bac,bca,cab,cba |
4D |
abcd,abdc,acbd,acdb,adbc,adcb,bacd,bcda,cdab,cdba,dcab |
abcd,abdc,acbd,acdb,adbc,adcb,bacd,bcda,cdab,cdba,dcab |
5D |
abcde,abced,abdec,acbde,acdeb,adecb,bacde,bcdea,cdeab,cdeba,decab |
abcde,abced,abdec,acbde,acdeb,adecb,bacde,bcdea,cdeab,cdeba,decab |
Parameter Constraints
Field |
Description |
Value Range |
|---|---|---|
--dir |
Propagation direction |
FWD_D (default) BWD_D |
--dt |
src/dst data type |
f32 (default) f16 bf16 s32 s8 u8 |
--tag |
src/dst data layout |
a ab ba abc acb bac bca cab cba abcd abdc acbd acdb adbc adcb bacd bcda cdab cdba dcab abcde abced abdec acbde acdeb adecb bacde bcdea cdeab cdeba decab |
--axis |
Dimension of the axis |
[0, tensor dimension–1] |
--group |
Group size |
Integer that is greater than or equal to 1 and can be exactly divided by the dimension of the axis |
[shuffle_desc] |
src/dst scale |
N1xN2xN3…xN5 |