If any have caused grief. The reference in this indirect way is to the incestuous person named in 1 Corinthians 5:1.
He hath grieved me, but in part. It was not Paul, only in part, that this man had injured and grieved, but the whole church.
That I may not overcharge you all. Lay too heavy charges on you.