Bargaining with Non-convexities

We show that in the canonical non-cooperative multilateral bargaining game, a sub- game perfect equilibrium exists in pure stationary strategies, even when the space of feasible payoffs is not convex. At such an equilibrium there is no delay. We also have the converse result that randomization will not be used in this environment in the sense that all stationary subgame perfect equilibria do not involve randomization on the equilibrium path. Nevertheless, mixed strategy profiles can lead to Pareto superior payoffs in non-convex cases.