Is there not a way to move magic items from one unit to another? Or they can only stay with the unit that found it?

Unfortunately, they only stay with the unit that found it.

You can probably edit the saves with a hex editor if you really want to move items. There are some emergency cases where you practically have to do this (for example if amber wizard picks up magic item that makes him unable to cast spells...).