To maintain screen direction, shoot from one side of the line of action only. The line of action (or axis of action) links the characters' eyes.

ALL ILLUSTRATIONS FROM STEPHEN KATZ's SHOT BY SHOT. This is an excellent textbook on directing, storyboarding, and compositional strategies. I highly recommend it.