CPU_BASELINE/DISPATCH in MacOS universal builds

when building openCV on MacOS with universal build (Intel + Apple Silicon) how to specify CPU_BASELINE and CPU_DISPATCH separately for each architecture?

I need NEON for ARM
and AVX/AVX2/AVX512 for Intel

I can build universal fat library for both architectures with all optimizations turned off, but that is obviously not a great solution.