Cannot remove crystal cave

When I finally got it down to lvl1 it says it cannot be removed. It says an error message. Don't know if this is a bug but maybe caves can't be taken out once it's built?