Unsure if this will be that relevant but...
I look at how they have pitched. For my starters a metric of FiP and WHiP gives me an idea of how they are pitching in the game. Of course seeing why your team won or lost helps whether it was due to poor hitting or pitching.
but once I get the metric (just multiply the FiP x the WHiP) i get a order of how I put my starters in order.
Relievers is a combo of their stats and going over the game reports to gauge how they are going.
Closer is a little easier, if the closer is not giving up hits/runs when he is pitching, he stays in
