Include prior two sentences for context. Speaker is in a tough situation.
however (now that it has gotten to this point), I cannot afford to hold back in regards to dealing with my relatives anymore can I?
I assume 遠慮もしていられない = cannot afford to hold back with extra emphasis from も
But how that interacts with 身内を相手に is very awkward for me. Literally i would read it as 身内を遠慮しない, but towards 相手 (one person in particular within the family, his mom?). But having both 相手 and 身内 is very confusing if 相手 is also 身内 as well...
THere's also the possibility of the speaker referring to himself in 3rd person as 相手 and using the passive tense, but i feel that has issues as well
What's the proper way to digest this sentence?