The Infant Insert is a fabulous accessory that grows with your newborn, so even if he no longer needs the extra support of the insert, you can remove the pillow and have him sit on that inside the Ergobaby Carrier, propping him at an appropriate height without confining him in the insert. This would be the best choice for your baby at this point.