I can't offer any advice but I can wish you good luck.
And your dream isn't foolish, it is what I hope to do one day too.
A friend of mine has done this and turned several fields which were just grazing land into a mini nature reserve - he's won awards for it - so it is possible.