Removing group calendar in favour of GEM also removes the clock display that sat over the day/night symbol next to the minimap. If you would like a simple replacement for this have a look at Alarm Clock Wrangler. It has not been updated for ages, so you may need to edit the .toc file with the latest wow build number.
Download from here:
http://wow.curse.com/downloads/details/591/