sar.sync_params

sync_params(model: Module)

Synchronize the model parameters across all workers. The model parameters of worker 0 (the master worker) are copied to all workers

Parameters:

model (torch.nn.Module) – The model whose parameters are to be synchronized. The model architecture should be the same in all workers.