The police on Wednesday were investigating a suspected criminal damage case outside Central Government Offices.
At around 8.30am, a security patrol found red paint covering an area of three metres by two metres around a planter pot near Harcourt Road.
The government strongly condemned the incident, saying the police will thoroughly investigate and hold any offender to account.
A government spokesman said police officers have stepped up patrols in the area and the authorities have instructed security staff of the Central Government Offices to remain vigilant.