These iconic shrubs aren’t the easiest plants to grow.