screenshot: fix libav API use (pix_fmt and some other things)