A cold weather advisory from the National Weather Service ends at 10 a.m. Thursday, as temperatures will climb around the Baltimore region.