In 1965, after moving to Chicago to play the blues, Steve Miller and Goldberg founded the Goldberg-Miller Blues Band, along with bassist Roy Ruby, rhythm guitarist Craymore Stevens, and drummer Maurice McKinley. The band contracted to Epic Records and recorded a single, "The Mother Song", which they performed on Hullabaloo, before Miller left the group to go to San Francisco.
By 1999, Goldberg both wrote and performed the theme to the Disney Channel original movie Smart House, entitled "The House is Jumpin'", with Phil Shenale and Sterling Smith, with vocals by Chan André. He wrote the song with Jill Wisoff and Joel Diamond.
In 2002, he was featured on the Bo Diddley tribute album Hey Bo Diddley – A Tribute!, playing piano on the songs "Pills", "I'm A Man" and "Before You Accuse Me" (produced by Carla Olson). Carla also produced Barry's Stoned Again album, which featured Denny Freeman, Mick Taylor and Ernie Watts.
In 2004, Shining Through The Rain by Percy Sledge was co-produced by Davis and Goldberg, featuring Larry Byrom, Denny Freeman, Clayton Ivey, Ed Greene, Phil Upchurch, Bob Glaub, the Waters, and Jakob Dylan, and songs by the Bee Gees, Mikael Rickfors, Carla Olson, Jackie Lomax, Earl Carson, Bobby Moore.
In 2012, Stephen Stills recruited Goldberg in founding a new band dubbed the Rides, culling some of Stills's best work from the past, adding guitarist Kenny Wayne Shepherd and session drummer Chris Layton. Goldberg co-wrote four songs on their first album, titled Can't Get Enough, released that year. The feature track is "Word Game". Much of the album reflects the work Stills did on the Super Sessionalbum with Mike Bloomfield in 1968. The album was nominated for a 2014 Blues Music Award for Best Rock Blues Album.
Goldberg appears on the Carla Olson album Have Harmony, Will Travel (released April 15, 2013, on Busted Flat Records) playing Hammond B3 organ on Del Shannon's "Keep Searchin'" sung by Carla and Peter Case, and piano and organ on the Little Steven song "All I Needed Was You", sung by Scott Kempner (The Del-Lords).
The Born in Chicago documenting Chicago blues was released in 2013, premiering at the SXSW Film Festival in March. Goldberg had been working on this project for a few years. It includes unique contributions by Bob Dylan, B. B. King, Buddy Guy, Hubert Sumlin, Eric Burdon and many others.
Goldberg produced three tracks on the 2013 EP (Drown in the Crimson Tide) by The Voice Season One semi-finalist Nakia with longtime friend Johnny Lee Schell.
In 2016, the Rides played with Neil Young at the Pantages Theater in Los Angeles at the Light Up the Blues event. The band later the same year released their second album, Pierced Arrow.
Goldberg produced and composed additional musical score to the documentary feature film BANG! The Bert Berns Story, which premiered at SXSW in 2016 and was released theatrically in 2017.
His latest CD, In the Groove, was released on June 15, 2018, on Sunset Blvd Records. The album consists of new and classic instrumentals, and features Goldberg on Hammond B3 organ, piano and Wurlitzer piano. Among the featured musicians and guests is jazz pianist Les McCann. The album was produced by Carla Olson.
Goldberg appears on the RENEW / BMG album Americana Railroad, released November 26, 2021, backing Rocky Burnette and James Intveld.