Goldberg's songs (some of which co-written with Gerry Goffin) have been recorded by many musicians including Rod Stewart, Gladys Knight, Percy Sledge, Joe Cocker, Steve Miller, Bobby "Blue" Bland, Gram Parsons and B. J. Thomas.

Goldberg's first professional recording session was "Devil With The Blue Dress On" / "Good Golly Miss Molly" by Mitch Ryder & the Detroit Wheels. Among the albums he contributed to are Leonard Cohen's Death of a Ladies' Man, The Ramones' End of the Century, Gram Parson's The Gilded Palace of Sin, and Super Session which featured Michael Bloomfield, Stephen Stills, and Al Kooper.