Help! I can't decide to lese this horse or not!?

If you aren't 100% happy I'd look around for a different horse- it would be awful if you lost your confidence around horses because of either the horse spooking easily or because of problems with the yard owner.