As a bassist I appreciate my hard to acquire callouses and try not to sand them off... I find that it helps to use hand lotion when doing stuff like that, and cotton gloves, or "Liquid Gloves" available from an autoparts store. Sometimes you just have to adjust your technique.