The director of audit on Wednesday recommended the government look into providing more transport services to the geopark, as well as to step up inspections and maintenance of the UNESCO site.
The geopark was certified by the United Nations body in 2011 as unified areas of international geological significance that are managed with a concept of protection, education and sustainable development.
The director of audit, Nelson Lam, noted that such status is subject to a "thorough revalidation" every four years.
Lam said staff from his office had visited seven geosites between April and August this year, and noticed behaviours that violated visitor guidelines, including littering, camping and collecting clams.
He said an investigation by his office also showed that the Agriculture, Fisheries and Conservation Department (AFCD) failed to meet the number of patrols and inspections set out in its own guidelines.
Lam added that auditors also found that some facilities, including signs and visitor centre equipment, were worn out or out of order.
The AFCD needs to step up efforts in repairing or replacing damaged geopark facilities, and update the record of geopark signs timely to facilitate monitoring and maintenance of the facilities, said the director of auditor in a report.
He also highlighted that there are currently no regular daily public transport services to some geosites.
Lam called on the relevant government departments to improve accessibility to High Island Reservoir East Dam, which is one of the main attractions of the park, as well as to review the public transport services to different geosites.
To better promote green tourism, the director of audit also recommended that the authorities should review their current system of handing out coach permits to registered travel agents.