If wanted to jump up to 162 games there are some of those already for 5/5/4 teams.
Keeping the 122 games and quickly playing with some numbers the first option I came up with was much more unbalanced than that 14/10 (division/league games) for the 12 teams. It would be (I think) something like 16/6 for the 5-team divisions and 20/6 for the 4-team divisions.
There may be a way to do something less unbalanced like 14/(6-9) & 16/(6-9), but with leagues with different size divisions it can be difficult to know for sure how well something might work without really diving into it.
If you have a preference for one of those directions I could work on the full layout to actually figure out if (and hopefully how) it could work.