Honey Bane began her musical career at the age of 14 in 1978 when she formed the punk rock band the Fatal Microbes. The band released a split 12" record with anarcho-punk band Poison Girls the same year. The first single, "Violence Grows" garnered some press attention and was given positive reviews by the British music paper Sounds.

After the 1979 breakup of the Fatal Microbes, and a stint in a juvenile detention facility that garnered more press attention, Bane began a collaboration with Crass, while she was on the run from the Social Services after serving a sentence at the St. Charles Youth Treatment Centre in Essex. Lending lead vocals and backed by the band under the name Donna and the Kebabs, Crass released the EP You Can Be You in 1979. It was the debut release on Crass' newly found label, Crass Records. The following year, Bane released her debut solo single, "Guilty", and sang vocals for Killing Joke on "What's the Matter" during a February 1980 gig at London's Venue club. The recording was later released on a bootleg album, Killing Joke - Live At The Venue LP.