"By the Grace of God" is talking about picking yourself up from a dark period in life. Hinting thoughts of suicide or the ending of her career, Katy Perry graciously sings, "...I looked in the mirror, and decided to stay. Wasn't going to let love take me out that way."