Ignore my previous comment.
All alocations as far as I am aware use a variant of cudaMalloc which states in the documentation that
The memory is not cleared.
Therefore it is not safe to make any assumptions regarding the initial values of any empty GpuMat containers.