not a teacher
Although "bruiser" does suggest a potential for violence, in my experience the "ugly" in this phrase has invariably referred to the person's unattractive appearance as per definition #1 in the link.
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: