For example, in 売り切れ, do the り and れ have a particular name? I found "okurigana" on wikipedia, but does that apply to grammatical suffixes only or does apply in these cases where it's mixed in the middle with kanji too?
Yes, you're essentially right. 送【おく】り仮名【がな】 is the name for kana used in conjugations of verbs and adjectives. There might be another name I'm not aware of, but I haven't heard of one just for kana in between kanji.
See here for more about 送り仮名. (Sorry, I entirely forgot you said you had already seen Wikipedia already.) Anyhow, 送り仮名 does not concern kana that just happen to be in between kanji. Those would either be particles or other words entirely.