As a geocacher I get lost on public footpaths all the time. Matters are made worse by the fact I usually have my bike with me and footpaths are never usually well sign posted. I haven't had any disputes like you but I always get scared that I will do.
Theres a few more stories on here
http://www.nwcaching.co.uk/forum/vie...php?f=2&t=2256