I believe that starving the colony will work only if the centre tile produces less than 2 food (not possible at all in the easiest difficulty); because otherwise the last colonist would never die of starvation. 
 
 --- 
 
 My solution: 
 
 If you are willing to go all the way to hex-editing then I assume using the cheat mode is all right too. 
 
 With cheats enabled do one of the following two: 
 
 - Go into viewing (press V, or right click on a map tile while on the main map), go with the cursor to the colony you want gone (using arrows, numpad, or right click directly on the colony tile) 
 
 or 
 
 - Go to the menu View / Find Colony, write the name of the colony you want gone and press enter. Same result as the option above. 
 
 Then, press SHIFT+D (the regular disband command hotkeys): you will be asked "Really disband [colony name]?", say yes and it'll be gone. 
 
 If there are any units outside the colony in the same tile you will be asked first to disband those units one at a time. 
 
 Be careful if using this without a previous savegame: when using "cheat-disband" indian villages get deleted immediately (no question) and all the units associated with that village will be gone too.