I took a look at the Japanese wikipedia article for Vegetarianism. I'm basing my answer on that, because I have little personal experience although I've been asked this a few times.
ベジタリアン is, as you said, an imported word. It has the same meaning as in english. There are different sub-types of vegetarian, etc. It also does not indicate the reason you are vegetarian. It could be for political beliefs, religious beliefs or even because you saw an animal getting killed once and just can't eat meat anymore.
菜食主義{さいしょくしゅぎ} denotes specifically a kind of vegetarianism guided by buddhist practices and beliefs. According to the Wiki article, it (sometimes) has an extra restriction on eating certain kinds of roots. Guided by the Wikipedia article in English on Buddhist Vegetarianism it seems some variations of Buddhism also disencourage consuming vegetables if this kills the plant, thus things like garlic and onion are also forbidden (this is called 禁葷食{きんくんしょく}). But not all buddhists follow this principle; some encourage it, others reinforce it only for monks, some not even for monks. There's a lot of variation apparently.
So when you talk about 菜食主義者{さいしょくしゅぎ}, you talk specifically about the reason one has a dietary restriction. It is because one follows buddhist faith and principles.
The short answer if you're looking for how to talk about your own dietary restrictions is motivation: unless it is this specific Buddhist set of beliefs that guides your vegetarianism, use ベジタリアン (ヴィーガン if that suits you better).