This city was once the capital of the whole district and was still referred to in the 19th Century as the "Kingdom of the Algarve". Most of the town and nearly all its ancient buildings were destroyed by the earthquake of 1755. The impressive remains of the castle dates back to Moors and there is a impressive underground water reservoir that is still used by the city today.

The city's earlier 13th Century Cathedral was built on the site of a Mosque and has suffered considerable alteration over the centuries. To the southwest side of the town is a modern statue celebrating the siege of 1189 in an appropriately named square, Largo dos Mártires, where it is suggested that the defending Moors were buried. Just to the northeast of the city is a fascinating 16th Century granite cross that is located beside the road to the north. The countryside around Silves is the biggest orange growing area in Portugal and other neighbouring towns share in the economic benefits from this product. There has been a popular recent decision to site a new University in Silves to recreate its links with its past.