If the bullpen is bad, you can often patch that with salary dumps from other teams. Or you may be able to upgrade your 3rd or 4th starter, then use the former 5th guy in the bullpen in long relief. If you can get a better setup guy or closer, then everyone else moves down a chair. Your bullpen should be 30% better at the cost of some backup and/or a couple meh prospects if you have room to take on salary.
If you're playing the current Chi Sox I'd think you have plenty of offense, but I'm used to the NL