Carey was born in Brooklyn, New York. Carey joined the U.S. Army as an enlisted man during World War II, served in Europe, and reached the rank of major. He received his bachelor's degree in 1942 and law degree in 1951 from St. John's University and was admitted to the bar that same year.

Running as a Democrat, Carey was elected to the United States House of Representatives in 1960. He served seven terms.He served on the House Ways and Means Committee and led the effort to pass the first Federal Aid to Education program. He was elected Governor of the State of New York in 1975 and resigned his Congressional seat on December 31, 1974. Carey was re-elected in 1978. He served two full terms as Governor. In 1983 he was succeeded by his lieutenant governor, Mario Cuomo. Carey returned to private law practice with the firm of Harris Beach in New York City, where he still resides. He was the first congressman from Brooklyn to oppose the Vietnam War.

Governor Carey was elected by a landslide in 1974 becoming the first Democratic Governor in twenty years. Carey considered running for President in 1976 and 1980. Carey is best remembered for his successful handling of New York City's economic crisis in the late 1970's. As Governor he was responsible for building the Javits Convention Center; Battery Park City; the South Street Seaport and the economic development of the outer boroughs of NYC. He also helped provide state funding for the construction of the Carrier Dome at Syracuse University. He is also remembered for preventing conservative legislators from reinstating the death penalty and preventing such legislators from taking away liberal state abortion laws. Carey came into office with New York City close to bankruptcy. He brought business and labor together to help save New York City from the fiscal crisis that befell it in the 1970s. Carey also fought hard to create an economically favorable climate for entrepreneurial and other business in New York State, primarily through substantially reducing, and in some cases eliminating certain categories of, state taxes.

Governor Carey signed the Willowbrook Consent Decree which ended the warehousing of the mentally retarded and developmentally disabled. His vision and leadership led to the community placement of the mentally retarded and developmentally disabled. He also made major strives in community programs for the mentally ill.

Along with Senator Edward Kennedy and Speaker Tip O'Neill he led efforts to end the violence in Northern Ireland and support peace in the region.

Governor Carey endorsed Attorney General Eliot Spitzer in April, 2006 for Governor of New York.

Preceded by: Malcolm Wilson Governor of New York 1975-1983 Succeeded by: Mario Cuomo