The castle was built in the first half of the 14th century by Henry of Lipá and named Pirkštejn in 1366 in memory of the original family seat of the Lords of Lipá and Dubá. Today the interiors of the castle are inaccessible to visitors.