Duel - Hornet

[BrusLee]

Anyone else having issue with dueling "Hornet"?
I know it is random encounter.. but it is quite annoying.. I met the guy just outside Troskowitz,.
Talked about rules and such, it was weird from start.. as soon as I accepted duel and "chat scene" ended, he was already swinging on me.
I won.. but erm had poison on the weapon after dealing with a camp of bandits, so I reloaded to "before talking with him".. now each time I pay for duel, he just leans back on post and refuses to react, talk or anything.

If I draw weapon out, he just comments and does nothing.. I can swing on him and basically "almost kill him" that sets off "You win duel!" scene, but then after he attacks me and is angry for violating laws -_-
Tried to reload 15 times.. I might just kill him now.. -_-