Born in the Little Italy section of Manhattan, Carrone was nicknamed "Buzz" because of his violent temper. He joined the Gambino family as an associate, working under caporegime Thomas Agro, and later Carmine Fatico, in the Bergin Hunt and Fish Club crew. He was involved in bank robbery and hijacking as a "stick up man". Carrone also trafficked small shipments of cocaine, marijuana and Quaaludes in Fort Lauderdale, Florida. His right eye was gouged or shot out, severing nerve endings and paralyzing facial muscles and giving the impression that half of his face was smiling. It is unclear how or who was responsible for Carrone losing his eye. As a result of the injury, he suffered from depth perception issues in the years following his accident. Fellow crew member Joseph Ianuzzi described Carrone before his disfigurement as "a tall and handsome Italian". Carrone suffered from narcissistic personality disorder, borderline personality disorder and antisocial personality disorder. After his disfigurement, Carrone's condition was made worse by a severe case of posttraumatic stress disorder.
Carrone was exiled from his crew and the Gambino family for robbing banks without Fatico's permission. Carrone now started robbing banks on his own. In May 1972 Federal Bureau of InvestigationSpecial Agents Patrick Colgan and Thomas D'Onofrio were looking for Carrone about a string of bank robberies in New York. A number of bank tellers implicated Carrone, describing him as "bizarre looking man with one eye and a gun". One day the two agents spotted Carrone exiting an apartment building in Little Italy. Carrone saw the agents and drove off. The FBI chased him at speeds up to. As the agents approached children crossing at a cross walk, they attempted to slow down, but their brakes failed. Carrone sped away, but immediately plowed into a woman's car. When the agents got out of their car, a bystander told them that Carrone was hiding under the steering wheel in his vehicle. Almost immediately, Carrone popped out and starting firing at the agents. In the confusion, Carrone managed to escape.
After the FBI shootout, FBI supervisor John Good approached Fatico and told him to give up Carrone. Fatico could not comply because Carrone had fled to Boston. This caused a period of major FBI harassment brought on by Carrone shooting at the FBI agents. Furious at the trouble that Carrone had caused the Gambino family, Fatico put a contract on Carrone. Fatico allegedly offered to induct anyone who murdered Carrone into the Gambino family. However, Carrone remained a fugitive. He was also featured as a fugitive on the television program America's Most Wanted, but no one turned him in.
In 1974, low on money, Carrone robbed a bank in East Boston, Massachusetts in the Financial District, Boston, Massachusetts. However, a silent alarm went off and Massachusetts state police troopers were soon chasing him. The troopers chased Carrone into some nearby woods. One trooper, tiptoeing through some heavy underbrush, suddenly heard three loud clicks behind him. He turned with his gun drawn and saw Carrone standing there, his gun pointed at the trooper's head; Carrone was out of ammunition, however. As the trooper leveled his own gun at Carrone, Carrone pleaded with the trooper, "Do it". The trooper spared Carrone's life and arrested him.