I'm reading a manga in which I've come across the following exchange (for context the second character, B, has just beaten up A in a fight):
A: おのれ きさまなんぞに...
B: いいや あたしなんぞに てめーは敗れるのさ!!
My understanding of なんぞに was always that it could be used similar to "Why", so the first comment it simply something along the lines of "Bastard, idiot, why...", but I've no idea how it then functions in the response from B.