No, it's quite recent thing (R25 I wanna say ?) in response to a lot of user feedback that it wasn't always clear which tool was selected.
Even if it is not particularly intuitive to remove it via the HUD settings, we can't deny that's the most logical place for it !
CBR