Road rage turned physical

A guy in the parking lot asks for a thank you for giving me way which funnily enough I did. Then tells me to Shut the f*** up. Gets out the car and I ask what tf his problem is. Gets my car key out and throws it way.

I’m forced to get out, he keeps his racial slurs going and I tell him to watch his mouth while pointing at him. Then he slaps me which I avoid with the back of my hand. I simply go away, grab my car keys and tell him “he wins” in front of his girlfriend as I had a 10 year old with me and did not want any further escalation. These days you can’t be sure what these lot are carrying in their pockets.

I’m thinking could I have punched him and humbled him without getting put any charges on me?