The castle of Charles V stands in the core of Salento chief town, few metres away from S.Oronzo Square. Significantly modified over the centuries (its fosse was filled in 1872), the castle preserves its trapezoidal layout with corner ramparts and lanceolate tops. Two concentric structures, built in different eras and separated by a court, testify the castle historical and architectural stratifications: inside the building there is a central structure built during the XII Century, before the construction of the sixteenth-century building. A quadrangular Tower, known as Square Tower, and probably of Angevine origin (XIV Century), is included in this complex. The castle is reachable by two entrances: a main entrance facing North-West (toward the city) is surmounted by the coat of arms of Charles V; on the opposite side, toward the countryside, a second entrance (Porta Falsa, False Door); both were once provided with a drawbridge.
The castle is composed of several floors: the vaults, once used as countermine; the level floor, with a court, probably used for service tasks, and the upper floor, with the residential area. For several years, the castle served as a recruiting centre. Today, it hosts several art exhibitions and other cultural events.