Companion Quest Line: Hired Musle- Idolaf Battle-Born Bug

[BootyBorn]

Hey guys I need help figuring out how to solve this issue!
I got hired muscle from farkas and my target is Idolaf Battle-born as the title said. My issue is every time I go to brawl him, once he gets down to a certain degree of health he stops the brawl and actually starts attacking me, putting a bounty on my head and the villagers start to attack me. He never acknowledges being defeated and I definetly didn't punch him enough to kill him. When I tried doing it slowly a second time, but he stopped brawling all together and walks away. When I approached him after, its like the brawl never happened and the option is in his dialouge bar again.

How do I fix this with out killing him and getting a bounty on my head? I really need the companions quest line to complete a build.

[Ozymandias]

You might want to check this mod: https://www.nexusmods.com/skyrim/mods/77465?tab=description