I would skip doing the improvements yourself and pay a crew. One day, done.
Your time on the easement would now be limited to your transiting. Makes it harder for him to harass you.
But be prepared to when he parks some vehicle at the road entry blocking your access. You know, “it just ran out of gas” Maybe some sign notice is necessary: “Video recording in progress” and “Blocking Access will be towed at your expense”
