It was the DSL modem. As soon as I replaced it with a $60 el cheapo from Microcenter (and configured said cheapo properly), I got my full bandwidth back.

I. Hate. Hardware.

But it is fixed now. A winner is me!.