Leroux: A bit off-topic and just an afterthought, but I think there's still a difference between visual novels and adventure "games" without real puzzles, because most visual novels I've seen really are only about reading and you just press a button to read the next lines of dialogue, while adventure games could remain more interactive even without the puzzles.
I've discussed it here before, so to me the thing that makes a game a game is that there is something trying to impede your progress (be it puzzles, action sequences requiring good reflexes and eye-hand coordination, tactical thinking, or whatever; that's mostly how games are categorized into different genres, ie. what is that impediment).
Otherwise they are just interactive... something. I know many disagree with me, and I admit something like Minecraft in creative mode is some kind of borderline case. In any case, even if I had a virtual tour program where the world interacts with me, but there is nothing impeding my progress, then I just consider it as a interactive virtual world tool, not a game.
Like. MS Paint is an utility and not a game, even if it can be quite fulfilling to create pictures with it. Minecraft in creative mode is a glorified version of that, a tool to create something virtual. Or a 3D CAD program that lets you create a virtual home and move furniture around there, is it a game?
Note though: the impediment can be quite light though. For instance, an adventure game without puzzles, there could still be an impediment that you need to find different places and objects before you can progress, even if there weren't actual puzzles impeding you. A bit like the hunt the objects adventure(?) games.