Bitry had a castle within the walls of which the church was understood, was a châtellenie within the abbey of St. Medard at Soissons.
The treatment was given in 1103 at the Cathedral Chapter by the Bishop of Soissons Manasses. There was a vicar instituted in 1633.
The castle belonged to the lords of Bitry, which were: Philip De la Fontaine, son of Philip and Mary Conty, born January 4, 1572, was lord of Bitry, captain of light horse. He married Anne of Bommercat who, after her husband died February 7, 1627, had a share of his property with her six children and retired to the convent of the Ursulines of Crespy, where she became a nun and died in the odor of holiness, May 28, 1642.
The Lordship of Bitry passed to his eldest son, Henry de la Fontaine, Lord of Bitry, born in 1606, he was Governor of Noyon in 1666. He married Marie Picard, 28 March 1636, and had: the Charles-Henri Fontaine, Lord of Bitry, Saint-Pierre and Yriet, born October 7, 1647, page from the great stable of the king, and died December 3, 1718. He married, December 15, 1705, Valentine Harlus who died February 12, 1721, leaving seven children. His daughter, Anne Charlotte, Lady of Bitry, was married in 1706 to Francis Dessessart, Lord of Lignière. None of his children bore the title of Lord of Bitry (P. Anselme). The manor then belonged to the Duke of Tremouille, Lord of Attichy. The common Bitry and Saint-Pierre-les-Bitry were combined into a single in the year 1827. They recovered, by royal decree of September 15, 1833, their separate existence.
The church (building), dedicated to St. Anthony and St. Suplice, is a large stone building of aircraft, which has undergone several revisions. The facade is in Renaissance style. The bell tower is a remarkable monument to the parts of 12th century architecture.