Why can't I join surf servers?

[:ekoe]

I can join other community servers, but not surf ones. When I try to join a surf server it asks me to download the map from the workshop, I click Accept and see it download the map, then it begins to connect.
I see it load the map, but as soon as the map finishes loading it just goes back to the main menu.