I figured out the problem. The problem happend when I tried to follow the installation guide at denseflow/INSTALL.md at master · open-mmlab/denseflow · GitHub
The guide builds libvpx.so.7 and other libraries beforehand and puts it in $HOME/app/lib. The solution is just to have that path in LD_LIBRARY_PATH.