In English, you have the following phenomenon:
○ I sometimes play jazz piano.
? I rarely play jazz piano.
That is, when you have a predicate that usually does not take place, you can use "sometimes" with it, but "rarely" is weird without further context, like "I play various styles of piano, but I rarely play jazz piano."
That is to say, "rarely" is not just specifying that the frequency you do the action is very low, but that you are somehow doing it less than expected.
You can contrast this with ○"I play jazz piano every once in a blue moon", which really just is saying you play jazz piano with a very low frequency.
Linguistically, I think this means "rarely" has a "negative polarity". As supporting syntactic evidence, it licenses negative polarity items like "any": ○"I (never→)rarely see any of them", vs ×"I (always→)sometimes see any of them".
Is 稀に negative like "rarely", or can you use it naturally with the following sentence?