Depends on your environment. At home, blocking all outgoing connections is very uncommon. You normally want to use the internet, that's why you pay for it.
In a corporate environment it is not uncommon to allow only specific outgoing connections, for example through a reverse HTTP proxy.