...Yeah, for comic books in particular, the stories have been going for so long and there have been so many different incarnations that making them into one big coherent story is impossible. I can't blame people for trying to make a storyline that arches over the entire series, especially since Nintendo has implied once or twice that Ganon is always the same guy, not a different person in a different age. But I think if you can accept that most of the games take place in their own little space and time, it relieves a lot of confusion and frustration.
I have no problem with voice acting as long as they include text and allow me to shut it off if I want. I do think the series is better off without it, but I barely notice bad voice acting and I totally see why a lot of people prefer it. I don't think there's any reason why you couldn't skip over a voiced NPC conversation just like you can skip over text ones...other than lazy programming...skipping over any piece of text should be possible at any time in any game.