It's won't be as simple as swapping on memory cards, if you want to switch PSN accounts on your Vita, you will have to do a factory reset (deleting everything on the system) since the account will be tied to the system as well. I don't know if you would be able to recover the PSN account after that, but who is going to be willing to erase everything on their Vita just to switch PSN accounts?