The Blue Jays did that to Cecil Fielder one time in 1988. They had him at 2nd base, but (surprise) he couldn't really play that position. So they swapped him over to 3rd base every time there was a lefty hitter at the plate. The Blue Jays lost that game and I don't think they ever tried it again. (Call me crazy, but maybe the Jays should have tried out Fielder as their full-time DH instead of Juan Beniquez

) I've considered this strategy in OOTP but I definitely don't have the patience for it.
May 2, 1988 Toronto Blue Jays at Seattle Mariners Play by Play and Box Score | Baseball-Reference.com
I think the Mets also did that once with a left-fielder and pitcher, but I don't recall the game anymore.