Parallelization to increase speed
Overhead of GPU usage
Network param size for making GPU usage worth it
Batch size for making GPU usage worth it