Abstract
We show how the simplex algorithm can be tailored to the linear programming relaxation of pairwise energy minimization with binary variables. A special structure formed by basic and nonbasic variables in each stage of the algorithm is identifified and utilized to perform the whole iterative process combinatorially over the input energy minimization graph rather than algebraically over the simplex tableau. This leads to a new effificient solver. We demonstrate that for some computer vision instances it performs even better than methods reducing binary energy minimization to fifinding maximum flflow in a network.