sdl: Consistently avoid grabbing input for text consoles