vfio/display: Fix missing update to set backing fields