Peter Vassiliou purchased 11 Nelson Parade at Hunters Hill, on Sydney's northside, in 2001, after being told the site had been cleaned of any contamination by the Health Department in the late 1980s.
But concerns about radiation levels in Nelson Parade were again raised earlier this year, prompting a state parliament inquiry into the site.
That inquiry found sections of the street needed to be remediated, especially 11 Nelson Parade, before the area would be safe for residential occupation.
Vassiliou, who has never lived in the house, said NSW Health had told him in July it would acquire the property at a "mutually agreed" value.
On that undertaking, he said he had prepared to move his wife and three daughters to Australia from Singapore on December 12.
But he said NSW Health were "going slow", failing to respond to written correspondence or requests to meet with Health Minister John Della Bosca.
Vassiliou said he would now arrive back to Sydney without a home to go to.
"We're now in a position where next month we're coming back to Australia and we're in a predicament where we are not going to have a family home," he told reporters from Singapore.
"It's unliveable, it's a health risk, we can't rent and we can't sell it. It's a dead asset for us.
"I can't sell it, so it's not as if I can go and buy another property to live in or if I have to rent something else I have to fork out money from my pocket because the government is not doing the right thing."
Vassiliou said this was not a "cash grab", he just wanted to receive payment for what he had lost.
He said he was also concerned for residents still living in Nelson Parade.
"I'm the guy who is most impacted of course, but there is wider issues than just myself," he said.
"This site continues to emit radioactive contamination and the residents who live around the area continue to put up with this health risk."
He said he did not want to take legal action against the state government, but said he had been "pushed into a corner" by their inaction.
"This is not an issue that should be swept under the carpet for another 40 years," he said.
"The new premier and new health minister don't appear to be serious about solving the problem."
A spokesman for Della Bosca said the government had agreed to "engage in discussions" to purchase the property, saying those negotiations were on-going.
