Prime Minister Anthony Albanese has also extended an olive branch to the Liberal leader, offering to come up with a constructive deal for constitutional reform in a personal appeal.
In a letter, seen by AAP, Mr Albanese asked Mr Dutton for any practical suggestions he wished to contribute to the voice proposal.
"It is an extraordinary opportunity for every Australian to be counted and heard - to own this change and be proud of it," the prime minister said of the referendum.
"As always, I am available to discuss these important issues with you in order to achieve a constructive outcome."
The prime minister says the model and shape the voice will take will be decided by parliament after the referendum, which will be focused on enshrining the body in the constitution.
Indigenous Australians Minister Linda Burney has flagged that the voice may not come into place in this term of parliament, saying there's no timeline on legislating the body if the referendum succeeds.
Ms Burney said while the "yes" campaign had more work to do ahead of the vote, it would be preferable for the Liberal Party to support the push.
"It would be extraordinarily wise and generous and in the spirit of what this referendum is going for, for that bipartisanship," she told The Australian newspaper.
The Greens also remain split on support for the referendum after outspoken senator Lidia Thorpe said she would not support the voice without a guarantee that the constitutional chance didn't cede Indigenous sovereignty.
Labor frontbencher Murray Watt said the government had advice supporting the sovereignty position and would be happy to provide the information to Senator Thorpe.
Greens leader Adam Bandt said his party wanted to progress all elements of the Uluru Statement from the Heart, which includes treaty and truth-telling processes.
"We've been in discussions with the government now for some months and working through issues," he told ABC TV.
"We've got the best opportunity for more than a decade, but potentially for a generation, of getting progress on First Nations justice.
"How can we ensure we get good progress on all of those elements?"
Uluru Dialogue co-chair and referendum working group member Pat Anderson will brief Mr Dutton and shadow attorney-general Julian Leeser on Thursday to discuss constitutional recognition.
"Part of the meeting today will be trying to convince him. He hasn't said no, but neither has he said yes," she told ABC radio.
"I know the Albanese government is keen to go to referendum with bipartisanship happening, so this is an important meeting."
The Alyawarre woman from the Northern Territory said governments hadn't been listening to Indigenous people, adding that a voice would have helped with some of the underlying issues that had led to unrest in Alice Springs.
"If we had a voice, I'm sure that all those local people would have said, 'hang about, we've got problems here and we need to find solutions and fix them'," she said.
UNSW constitutional law professor Megan Davis, also an Uluru Dialogue co-chair, said she wanted to help clarify the mechanics of the voice and why it was important.
"Our hope is that Mr Dutton and his party room support First Nations peoples and help bring the whole country together to make this important constitutional change," she said.
Bipartisan support has historically been needed for referendums to succeed.