How do you get good curvature maps?

[Hitpawz]

Mine look horrible beyond belief. I have both world space and tangent space normal maps baked at 4096 and those look perfectly fine, but when I build the curvature map using either one of those, I get all of these black and white pixel spots, horrible amounts of noise and not clean blends at all.

I tried lowering the detail setting but clearly that's just lowering the contrast of the same image.

I'm baking my normals from mudbox because I can use subdivision mapping instead of raytracing and I avoid any issues with embedded surfaces making a bunch of artifacts. Again, those normal maps are essentially flawless.

What am I doing wrong?

[Hitpawz]

Curvature Image [www.ratsarmy.com]