The first boat was carrying 26 migrants from Bangladesh, four of whom died on Thursday, the Red Crescent said in a statement on its Facebook page on Saturday.
The second boat carried 69 migrants, including two Egyptians and dozens of Sudanese, the Red Crescent added without specifying their fate.
Khums is a coastal city, some 118km east of the capital, Tripoli.
On Wednesday, the International Organisation for Migration said that at least 42 migrants went missing and presumed dead after a rubber boat sank near the Al Buri oilfield, an offshore facility north-northwest of the Libyan coast.
Libya has become a transit route for migrants fleeing conflict and poverty to Europe across the Mediterranean since the fall in 2011 of dictator Muammar Gaddafi during a NATO-backed uprising.
Pictures released by the Khums Red Crescent showed a line of bodies in black plastic bags laid out on the floor, while the volunteers are seen providing first aid to the survivors.
Other pictures show the rescued migrants wrapped in thermal blankets sitting on the floor.
The statement added that Coast Guards and Khums Port Security Agency participated in the rescue operation. Adding that the bodies were handed over to the relevant authorities based on instructions by the city's public prosecution.
In mid-October, a group of 61 bodies of migrants were recovered on the coast west of the capital Tripoli. In September, IOM said at least 50 people had died after a vessel carrying 75 Sudanese refugees caught fire off Libya's coast.
Several states including Britain, Spain, Norway and Sierra Leone urged Libya last week at a UN meeting in Geneva to close detention centres where rights groups say migrants and refugees have been tortured, abused and sometimes killed.