Non-game and non-gamer are pretty silly, but there is a need to specify those games from other games, just like any other genre.
Any suggestions?
Personally, games like WiiFit are actually apps in that they are supposed to be appllied in order to reach a goal. Brain Age and others fit into this app group. However, there are games like Animal Crossing that don't really fit anywhere. It's like a virtual world where there is no goal but to entertian yourself. Those games are more like toys, in that they take extra creativity from the user to make them more entertaining.