Except that would leave out the softness of heads and hands.
So I'm still stuck with at least 4 areas: getting to the ball (speed), throwing the ball (arm), knowledge of the position (intelligence/awareness), and handling the ball (hands).
Thanks for making me think of it in that way, though, but I can't really see reducing under those 4 areas that comprise fielding at the major league level.