Allen has been accused of child sexual abuse by his adopted daughter Dylan Farrow, with Allen's ex-partner Mia Farrow and their biological son Ronan Farrow backing her claims. He has always denied any wrongdoing.
However, Jeff, who had a small role in Woody's hit 1977 comedy "Annie Hall", said he won't be joining other stars who have previously worked with the director in promising to shun him in future.
"I think there is a presumption of innocence until proven guilty," the actor told British online newspaper The I. "I know I enjoyed working with him many years ago and I sat in with his band once too."
The 67-year-old star did offer his backing to the #MeToo movement, but said he would have to learn more to confirm that the allegations against Woody were true to boycott his films.
"Even though I feel like this cultural shift (the #MeToo movement) is very, very positive and long overdue and I support it wholeheartedly and take it very seriously, I also admire his body of work. So I would consider working with him again, until I learned something more," he added.
Jeff's words sparked a huge backlash on Twitter, with fans "cancelling" the star for his controversial comments about presuming the filmmaker's innocence.
"When I saw Jeff Goldblum was trending I worried he might be dead," Twitter user @MrRaceBannon wrote. "This is so much worse"
Woody was first accused of child sexual abuse by Mia during a bitter child custody dispute. The couple split after Mia discovered Woody was having an affair with her adoptive daughter Soon-Yi Previn. The allegations resurfaced in 2014 when Dylan wrote an open letter to The New York Times and has received renewed scrutiny in the wake of the #MeToo movement.