There is plenty of clay in the mist of the farm. You can also occasionally find clay while exploring outside. When you reach Hope Mountain, a minecart icon will appear at the bottom left of the screen. Click on the minecart icon, and it will guide you to the mineral locations.  

If Piero's shop at the farm entrance is open, you can also hire him to find clay for you.