Yeah...even in the Big Finish audios, which portray the Time Lords as pretty laid back, they're not a species you want to piss off. (Granted it takes a lot to piss them off, and they're more likely to deflect than engage.)

Although I think a lot of the decisions they're forced to make have some sort of morality in a four-dimensional sense, but not really from a human perspective.