Select none shouldn't deactivate current mode

When we are selecting objects with a selection mode like add/remove, it we tap on select none, the mode becomes inactive or changes. It should ke kept.