Joseph Kundeck purchased lots for the town of Celestine and 20 acres for the church from the U. Kundeck platted the 20 acres for the church on November Joseph in Jasper, and St. Ferdinand in Ferdinand. Peter Celestine, which was built as the first of four churches. For the next five years, Fr. Kundek, stationed at St. Joseph, Jasper, came to Celestine once a month to celebrate Mass.
On October 17, the parish celebrated a three-fold festival. First, at 7 am the Bishop administered Holy Orders to six priests and deacons. Second, came the confirmation of children. Thirdly, at 10am the new church was dedicated, and High Mass was held. Charles Bilger, the priest at St. Peter Celestine, held a meeting on September 21 to establish a church in Dubois then Knoxville.
On October 13, the deed was made for the provisional three and half acres of the church with the land donated by John Seng. Raphael was the eighth Catholic parish established in Dubois County.
Bilger informed the congregation the church was paid for, and the extra money would be used for a rectory for a priest. The rectory work began on January 30, Bilger remained the priest for both St.
Peter Celestine for three years until Services were held at St. Raphael on the fourth Sunday of each month. Zierkelbach became the first resident priest of St. Raphael Church in July. Lawrence Fichter built the present rectory on the St. Celestine campus. It was a kit ordered from Sears and Roebuck and was assembled to specifications by parishioners. The rectory was used by priests in the surrounding area. The housekeeper also had her own quarters in the rectory.
