Moving silos, barns etc.

[CoLS Firestar]

I remember a post a while ago... someone said they had destroed thier stable so they could move it somewhere else and there was no option to rebuild it.
I'm thinking of re-arranging my farm and wanted to know if this was still a thing. Can I destroy barns and coops and silos ok?