It's hard to say. It could mean the person did other things (yelled at him, verbally intimidated him, maybe even pushed him), but did not physically strike him with force. Or it could mean the person did nothing to him at all, but he was tempted to, to, and almost got to the point where he would, hit him.
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: