Vehicles which are being driven on a Rother recreation ground are causing 'extensive damage', say police.