Characterizing sets of lower bounds: a hidden convexity result