Milford was a Madison county town founded in 1787 and said to be named for a slave owned by John Kincaid. It was the county seat until 1798 when it was moved to nearby Richmond. Nothing remains of Milford, which was located on a hill above Taylor Fork.