He was elected County Clerk in 1860, admitted to the Bar in 1862, and served the County as Prosecuting Attorney 1864-1870. Stone was President of the village of Allegan in 1872 until being elected to the 20th Circuit Court in April 1873. He held that bench only 19 months before resigning in November 1874 to move to Grand Rapids and reenter private practice.
From 1877 to 1881, he served the State as a Republican representative in Congress, after which he was appointed by President Chester A Arthur as United States attorney for the western Michigan district in 1882. He would go on to serve as a judge in the 25th Circuit (Houghton, Michigan) from 1890-1909, and as a Justice of the Michigan Supreme Court from 1909 until his death in 1922.