Plans to knock down a garden centre and turn it into 12 homes to meet the demands of "growing families" have been approved.