Interesting... I just read an article that said it's a common thing for this generation to sleep apart. I'm old school, I need my wife next to me or I can't sleep.
Being as how as men we don't have a vulva or breasts (at least most of us don't), If a woman craves that and you are comfortable in your relationship, then why not let her have the occasional dalliance. If it came down to physical and emotional preference for women, then obviously you are in a doomed relationship. Just as long as it is understood that there is only one penis in the equation. But... that's just me.
I don't have to even consider that scenario as my wife is not even slightly inclined towards that.