board_group_rmlib(): Further optimize gi->lib[] shrink