The caterpillars have devoured the first plant and have found the 2nd one. Since they are small ones and they are eating through them in less than 2 weeks, I went in search of some more. I got 3 big plants that have buds to bloom and got some fennel for the butterflies. I asked the lady about why at certain times of the day they appear to be gone she said they eat when it is cool, that makes sense, so when I got out at various times they may be hiding in the shade so they don't get too hot. New plants are in the ground waiting for new caterpillars.