According to the Kiss With a Fist Songfacts, this sexually charged number was written when Welch was hanging out with art college dropouts. She told The Sunday Times: "It's about giving as good as you get."
Florence explained the song's meaning on her Myspace:
"Kiss with a Fist" is NOT a song about domestic violence. It is about two people pushing each other to psychological extremes because they are fighting but they still love each other. The song is not about one person being attacked .