I do them whenever it's most convenient, though usually before moving to story quests, due to some side quests being closed off when the story progresses (as some have mentioned already.) I do like to complete most if not all quests in a game, and I feel like I'd be missing too much content if I just barreled through the main story quest to the game's end without exploring the rest of the game. There have been exceptions (I skipped a couple side quests in the first Mass Effect, I've skipped a bunch in Sacred 2 because hell, there are just too many, and I'll skip them if I out-level them and there's no real benefit, unless the story is good enough to just want the lore involved in the quest.)