The author and illustrator felt compelled to pull on those moments of peace when writing his latest children's book, Once I was a Giant.
His third published work, the father-of-two is honoured for it to be named the Children's Book Council of Australia Picture Book of the Year.
The book aims to bring trees to life for young readers by using an imaginative story rooted in recent scientific discoveries about the social lives of trees and their abilities to communicate, learn and feel.
Sworder told AAP much of the inspiration was drawn from his childhood, where he grew up with no car or digital devices in the regional Victorian city of Bendigo.
It was there he discovered the ideal climbing tree.
"It was perfectly shaped for my little limbs to climb up fairly high. I spent a lot of time with that tree," Sworder said.
"I carried that relationship and love for trees with me into adulthood. In 2018-19, there were growing movements within Australia, particularly within Victoria to end logging of old-growth forests.
"I was reading lots of books about trees, non-fiction books for kids with my daughters and I learned about recent discoveries into the way trees communicate through their root systems."
Through research, Sworder had the idea to write a story from the perspective of a tree and see the world through its senses and perspective.
"Nature has always played a big role in my life," he said.
CBCA board chair Jo Panckridge said the awards highlighted the extraordinary talent of Australian authors and illustrators.
"Reflecting on eight decades of advocacy for Australian children's literature, we continue to celebrate the enduring and transformative power of stories for young readers," she said in a statement.
"Such skill in crafting stories that ignite curiosity, empathy and joy is remarkable."
Other winners included Barry Jonsberg's Darkest Night, Brightest Star, which took out the older readers category.
Emerging children's author Karen Wasson and illustrator Jake A Minton won the younger readers category for a graphic novel about an opera-singing octopus.
An ancient Chinese folktale about integrity, courage named The Emperor's Egg by Rae Tan was named the best in the early-childhood category.
Author Stephanie Owen Reeder and illustrator Ingrid Bartkowiak won the Eve Pownall Award for Peculiar Parents, while the new illustrator title went to Eleri Harris for A Loo of One's Own.