At the high school level, I would let your DS pick whatever he wants. He could be picked on in PE, weightlifting or even in math class depending on the mix of kids. I understand your DH's concerns, it's easy to let our experiences color our opinions, but there's no way of knowing what will really happen.
Do you know any other parents of older kids at that high school? Speaking with moms who know the lay of the land at DS1's high school has been invaluable in picking classes.
Mom to Two Wild and Crazy Boys and One Sweet Baby Girl