Possibly built upon some Roman remains, the Lozoya Tower was built in the 15th and 16th centuries, reflecting two very different stylistic periods: the first being the late Gothic period - with a strong Mudejar (Hispano-Muslim style of masonry) influence - and the second being the Renaissance period. 

The medieval construction suggests a fortress-house, probably the work of the Cuéllar family, featuring an impressively large tower that gives its name to the building and which provides the  entrance to it. Alongside this is another smaller tower, both leading to an early courtyard. All of this must have formed a miniature castle, a true reflection of the conflicts that Segovia experienced during the late Middle Ages. 

The second decisive stage in the history of this monument began in 1563, with the acquisition of the building by D. Francisco de Eraso, Secretary of the Chamber and State Councillor of Charles I and Councillor of the Treasury and the Indies of Philip II. He transformed the medieval mansion into an impressive Renaissance palace. The most important remains of the palace can be found in the courtyard and in the arcade that was designed to enjoy the garden.  

The building currently houses the exhibition rooms and museum of the Torreón de Lozoya Foundation.