When Elizur Kirke Hart died in 1873, he left $50,000 to the Presbyterian Church, directing that a new edifice be erected. According to legend, he also stipulated that he wanted the new church to have a steeple taller than the one on the local Baptist Church. Hence, the most dominating landmark at the Courthouse Square is the Presbyterian Church spire, reaching 175 feet in height. This is entirely made of brown Medina sandstone quarried locally in 1874. The church was designed by A.J. Warner, a noted Rochester architect in the late nineteenth century. The Gothic Revival styling emulates European cathedrals of the thirteenth century.

The magnificent interior displays many gothic arches, supporting a clear story. The stained glass windows in the Tiffany style were installed one hundred years ago, replacing the original stained glass. At that time Charles Howard Allen, a decorator, was hired to paint the interior walls and ceiling. In 2007, the congregation of this church, at great expense, had the interior painting totally restored to its 1910 grandeur- a spectacular achievement! Consequently, this all enhanced the beautiful solid walnut woodwork, a treasure in itself. The Albion community is fortunate to have such a caring congregation that sees their landmark as an enhancement of our heritage