You have found the area where your ancestor lived in the mid 1800’s. And, you have determined where it was that your ancestor went to church. Where are the records?
Sometimes the exact same church will have the records that contain information concerning your ancestor. However, sometimes it will not.
Did their church keep the records? Or, were the records donated to a repository for records of the denomination? Another possibility is that their church became a “part” of a larger congregation. In this case, the “newer” church may have the records.