Acid Horse was a one-off single collaboration between Ministry's Al Jourgensen (Alien Dog Star), Chris Connelly (Gallopin' Scorpionsaddlebutt), Paul Barker (Tennessee King), and Cabaret Voltaire's Stephen Mallinder (Biff) and Richard H. Kirk (Harold Sandoz). The name of the project is a combination of the slang terms for LSD (acid) and heroin (horse), as well as a play on the title of the then-popular acid house movement.

Acid Horse recorded their "No Name, No Slogan" in 1989 for Wax Trax! Records. The same song was performed differently on each side, one produced by Ministry and the other by Cabaret Voltaire.