ok I have just noticed that there is a bug in the --generate but --min=0 path.
I will perform an additional test witht the bugfix. So currently, the 12 ms results are for random batch size.
1 Like
ok I have just noticed that there is a bug in the --generate but --min=0 path.
I will perform an additional test witht the bugfix. So currently, the 12 ms results are for random batch size.