Although selection favors exploitative competition within groups, a group of hypercompetitive individuals may be less productive than a cooperative group. When competition is costly for group fitness, among-group selection can favor groups with 'policing' individuals who reduce within-group competition at a cost to their own fitness, or groups of individuals who restrain their competitive intensity ('self policing'). We examine these possibilities in a series of explicit population-genetic models.