The Senate on Wednesday confirmed former Rep. Lee Zeldin of New York to be the administrator of the EPA by a vote of 56-42.