If I set my garden to attract butterflies, wouldn't the caterpillar do damage to the foliages?

This is always a possibility so your best bet is to find out what caterpillars really like best and plant some of it just for them. Actually there's an easier way to grow an incredible garden without the traditional hassels like weeding, fertalizing, garden pests, etc... check the link in Source below for more info.