I’m giving this a look now, and because I’m too lazy to find my old code, I’m rediscovering fine points such as using the optflow in reverse because it’s got push/scatter semantics which are contrary to how remap() works.
and I’ll definitely have to inject some estimate of the lighting variations of the actual image. in optical flow there is the brightness constancy assumption and if that isn’t met, results suffer.
a trivial prototype application of DIS optical flow shows that it’s misassigning parts of the grid even though the displacement isn’t so bad that this should happen. I suspect the brightness constancy stuff. I’ll have to fiddle with its parameters. maybe it’s not pyramiding up well enough. maybe I’ll have to swap the optflow algorithm, at least for initialization.