Hilary Duff wears a loose tunic and boots while the pregnant star seeks Whole Foods with Matthew Koma