The prospect of doing what you have described is probably what will drive me to sell up where I am and buy a house. I love my apartment and it is great in winter but when the summer comes I really miss having an outdoor space. I don't want anything massive, just a small paved/gravelled area I can sit out in and have a tea / lager / whisky when I fancy it.
Ideally a penthouse apartment with a private roof terrace would be the best of both worlds but not many of those about!