Check the binaries actually exist in the place we expect.