Playing in the shadow of Toronto's iconic CN Tower, and in front of a sea of red "Ca-na-da!"-chanting fans that included hockey star Connor McDavid and actor Ryan Reynolds, Larin converted Promise David's pass a mere two minutes after entering the game on Friday (Saturday AEST).
The goal was only the second in World Cup play scored by Canada after the team lost all three of their games at the 1986 tournament in Mexico and again four years ago in Qatar.
Injury fill-in Jovo Lukic headed in a corner kick in the 21st minute for Bosnia-Herzegovina, who are making their second World Cup appearance after failing to advance out of group play in 2014.
Starting in place of Edin Dzeko (shoulder) and Haris Tabakovic (undisclosed), Lukic was in an ideal position to cap off a set piece, with captain Sead Kolasinac flicking along a header off Ivan Basic's corner kick.Â
The goal was Lukic's first in international play and came in the 27-year-old attacker's fourth international appearance.
Despite giving up the lead, the small Balkan nation of about three million people keep coming up big on the international stage - including eliminating four-time champions Italy in the European playoffs.
Before Larin's goal, Canada's best scoring chance came in the 54th minute when captain Stephen Eustaquio fed the ball to Richie Laryea in front of a wide-open net. The ball deflected off Kolasinac's foot and hit the crossbar.
Canada were playing without Alphonso Davies (hamstring), who scored the nation's first World Cup goal four years ago in Qatar.
Canada now shift to Vancouver for their final two group games, against Qatar on June 18 and Switzerland on June 24.
The Bosnians also head west, with games against Switzerland on June 18 in Los Angeles and Qatar on June 24 in Seattle.