I've put about 15 hours into this game, and up until now, I think it's been a great experience overall. However, it seems that I have yet to reach many of the areas where people have concerns (I'm only in the third dungeon). I'm really eager to see what comes next, and am hoping that I won't be disappointed. I suppose time will tell.
As far as having any issues with the game, nothing has really pushed me to the point of frustration. I thought the flight controls were terrible at first, but I picked them up rather quickly and haven't had a problem with the since. There have only been one or two instances where the calibration has been thrown off, and as far as any difficulty wielding the sword, my only problem has been the seemingly oversensitve nunchuk. It seems that the slightest movement of the nunchuk while targeting an enemy will cause Link to do his spin attack. It's only posed a significant problem while trying to stab enemies, however.
Other than those tiny gripes, I've been completely enthralled with the game so far. I just want to keep playing it. Hopefully, as I put more time into it, that won't change.