Under a partly linear model we study a family of robust estimates for the regression parameter and the regression function when some of the predictors take values on a Riemannian manifold. We obtain the consistency and the asymptotic normality of the proposed estimators. Simulations and an application to a real dataset show the good performance of our proposal under small samples and contamination.