Exilles is best known for its imposing castle, whose origins are ancient, dating back at least to the twelfth century. It is linked to the famous story of the Man in the Iron Mask. The Man in the Iron Mask was imprisoned at Exilles between 1681 and 1687. The town belonged until 1713 to depart from Briançon. Until 1713, it protected the entrance to the French territory. Destroyed by the French in 1796, it was rebuilt between 1821 and 1829 and remodeled in 1874.