Abstract Geometric detail is a universal phenomenon in real world objects. It is an important component in object modeling, but not accounted for in current intrinsic image works. In this work, we explore using a non-parametric method to separate geometric detail from intrinsic image components. We further decompose an image as albedo ∗ (coarse-scale shading + shading detail). Our decomposition offers quantitative improvement in albedo recovery and material classifification.Our method also enables interesting image editing activities, including bump removal, geometric detail smoothing/enhancement and material transfer