I joined Freedom recently and I regret it because it makes going to the 100 Rads Bar, a huge pain in the ass. You have to fight Duty members every time you try to go there. So I came to the conclusion, being a Loner is best.
I had a similar problem but it was only one guy. Took a while to figure out how to kill him but once he was gone, I could come and go in the bar as I pleased. If you managed to kill him, did new Duty folks appear later?