inet: Don't go into port scan when looking for specific bind port