No one was injured in the blaze at Dolphin Sands, although one firefighter was treated for smoke inhalation.
Authorities say several other structures have likely been impacted by the fire, which spread across more than 110 hectares.
"This morning a comprehensive impact assessment of all properties in the affected area will be undertaken as a priority," Tasmania Fire Service said in a statement on Monday.
It is the second serious bushfire on the state's picturesque east coast in recent months, after a blaze at nearby Friendly Beaches forced evacuations in September.
Tasmania Police sent up drones to help with damage assessments on Sunday night.
The fire, reported at 6pm on Sunday, moved rapidly in strong winds before moderating and being downgraded on Monday morning.
But it's not yet under control, with 14 fire trucks and 30 career and volunteer firefighters battling the blaze overnight.
Two dozen people who gathered at the Dolphin Sands boat ramp were safely escorted from the area.
An evacuation centre was set up Swansea Town Hall.
Powerlines are down on Dolphin Sands Road, which has been closed at Yellow Sandbanks Road and will remain so until it's safe.
"Every effort is being made to allow property owners to return to the area as soon as possible," Tasmania Fire Service said.
The cause of the fire is being investigated.
5°C