UMat to Mat, how can I save time?

When I convert Mat to UMat type data in the program, it basically takes no time to convert, but the conversion of UMat matrix to Mat matrix is very time-consuming (from gpu to cpu). Is there any way to speed up or save this part of time?