Because he not only had broken the Sabbath. The Pharisees were horrified, not only at what they deemed the breaking of the Sabbath, but at the high ground on which the Lord placed his defense.
But said also that God was his Father. This high claim seemed to them blasphemous.