Ok so ive been playing as a guard and i maxed out the guard guild and raided and destroyed all the thieves guilds in town. I then set my sights on the robber hideouts outside the town wall. I recconed it to 100 percent like i always do and then raided it with 6 guys. Only when they got there it said they couldn't find the place and i should be better prepared next time. This has happened twice so far.

How do you raid the robber places on the out skirts? I'm i unlucky or am i doing something wrong.

Update:
This is probably really inefficient but upon finding that i couldn't target the robber places for sabotage I built a palace with fully upgraded cannon tower and blasted the robber places until they were almost worthless. I then bought them very cheaply but it wouldn't give me an option to tear the place down like it did with the thieves guild.

Is there a way to totally get rid of the robber guilds and stop the annoying cart robberies? Or do you just have to buy them all and fire all the employees.

Also i found that when my cannon tower made a building have a large negative value and i clicked on the info button to buy it my game would crash. Has anyone else run into this problem? Is their any way to totally remove buildings by shooting them with the cannon tower?

I had this happen the first time I tried when my recon was at 96% or so. You do lose a bit of recon every year that passes, so make sure that you're attacking the same year you have 100% recon. My guys had a ways to walk to get to the robber hideout, so I sent them out to recon near the end of the year before so that they got there at the beginning of the next year. As I've figured, those robber hideouts are "special" buildings (like the town hall or marketplace), so you can't destroy them. If you want to get rid of all the robbers, it seems the best way is to take over the buildings and fire everyone. I did this with guard posts so I could rob the whole town without being harassed.