If you wish to play without certain creations you must either rename their respective .esl or .esm file, or you must remove them from the Data folder of where you have Skyrim Anniversary Edition installed (example C:\GOG Games\Skyrim Anniversary Edition\Data\). The Creation Kit is also not included. You will need to obtain that yourself.
The should-be standard version of Skyrim for modding, given that you can choose which update to install, and it will never update automatically and break your mods. The biggest thing lacking from this release of Skyrim is that it does not come with the Creation Kit. You will have to obtain it yourself.