College career path dilemma/decisions?!?

No, go with physics. There's no limit to how many physics majors a school can take, and a B- doesn't mean you won't go on and succeed in physics. If you want to do physics, tell them you want to do physics. I got a C in high school physics, and then went on to do very well in college physics cles and now I'm getting a PhD in physics (astrophysics).