Nvidia Notebook 3050 Ti and i7 12700 is giving same performance for debayering RAW to RGB

My end goal is get 60 FPS with 4K RAW to RGB conversion. But I am getting around 40 to 42 FPS while doing debayering using cv2.cvtColor() method for CPU and cv2.cuda.cvtColor() in case nvidia GPU.
FPS are same with CPU (i7 12th gen 12700H) and with CUDA supported GPU(RTX3050Ti).
Is there any other method to increase FPS (performance)?