How to choose batch_size, num_workers, prefetch_factor, AMP, and CPU/GPU settings for ACT training and inference.
Transformer from scratch.