I feel as though I like the CAD part of the program rather than all the math/physics/structural part of it. And also over the next two years I am only going to be taking 1 CAD class. So over a total of 4 years I will only have taken 3 drawing classes, which I don't think is right. When we went to a design firm to talk to some people they highly recommended taking as many drawing/cad classes as you can.
That is what engineers are for.
From my understanding:
You'll be working with structural and mechanical engineers for most of the math/physics/structural side of the design. You'll of course need a basic understanding for any actual design work, but the serious math side will be done by engineers.
Again, not sure how it works for architecture, but in my engineering program i had to take technical electives. There were a ton of them divided into groups. You could specialize your classes to fit what interested you the most, like fluid mechanics, materials, stress analysis and failure prevention, thermodynamics, systems and controls, etc. I'm sure there has to be something like this. Allowing you to take more cad, drafting, or design courses.
You can learn quite a bit about cad/cam programs in one semester too. Once you learn what you're doing all it really takes is some practice to get truly good at it. You can easily do that on your own. Most programs i've used are pretty similar and it doesn't take long to move from one to the other.