Ants are in their natural habitat outdoors, which includes the garden you've worked so hard on. Ants in the garden can be a good and bad thing; it kind of depends on the species. Regular old yard ants can be beneficial in reasonable numbers, helping to spread pollen and killing other more destructive pests like caterpillars. Ant infestations are another thing. If you find yourself looking at a garden full of ants, you should take some measures to control them. If you have fire ants in your garden -- even a small amount -- you'll want to get rid of them or suffer the consequences when you're gardening.