For nonparametric regression, where the regression function has discontinuity points, the kernel regression estimator and cross-validation are known to be affected by discontinuity.

Bruce Peterson, A Function with a Discontinuous Derivative, The American Mathematical Monthly, Vol. 89, No. 4 (Apr., 1982), pp. 249-250+263 ...