People like us probably don't make an impression.
I belive 残る is intransitive so I suppose the literal translation is more like "For people like us an impression is probably not left".
I don't understand why the particle に is used here. Why is it not が? How would the sentence change if I replaced に with が?