The purpose of this paper is to introduce a new method for removing reflections from multi-view images taken through a transparent medium, such as pane glass. Our method utilizes an optimization approach based on the probabilistic model of relative smoothness algorithm which has certain limitations. We improve upon this algorithm by imposing a gradient-sparsity constraint, which allows the in-focus reflection to be effectively removed. We also introduce another constraint on a disparity map which smooths specific areas of reflection layer while simultaneously preserves the sharpness of the main object. These two major contributions are proven to be sufficient in producing high-quality images. Our algorithm demonstrates good results compared with other existing methods as most of the reflection spots have been removed, and the computational time of our system is arguably fast.