殺され is passive. As has been so kindly pointed out in the comments, the sentence reads, "I came to be killed by you".
For a moment though, let's look at a slightly simpler sentence:
This sentence reads "I was killed by you".
In a passive sentence, the agent, the one who's actually doing something, is marked by に。
In order ...