More garden woes

I'm really struggling with gardening.  It is so incredibly frustrating.  I feel really defeated. 

The other day I went to the garden to plant zucchini and winter squash.  While there I found some of the biggest grubs I have ever seen.  At first I was screaming "why???" inside my head.  Then it hit me.  Everyone around me at the pea patch uses chemicals.  I do not.  I have been working hard over the past year to improve the worm-less soil.  I've added a lot of compost, planted nitrogen fixers, and gave it rest over the winter.  During this time, I didn't think about the fact that I was actually sending out messages to all the pests in the area that I was providing a free lunch. 

So, when I went to the garden and discovered ants brutally attacking my beans, I was angry.  I am working so hard and it just seems like wasted effort.  Do I keep persisting?  Or do I just throw in the towel? 

I have yet to decide.  But right now I have several cucumber, tomatoes, and tomatillo starts in my spare room.  I guess what I'll most likely do is plant them and hope for the best.