This is how I understand the sentence:
84 If you are a man who'd drop me for this
85 won't you fall in love with me first?
But it's such a weird thing to say. Something like "...you couldn't have liked me much to begin with." would make more sense to me, but it's not written. I think.
Context: It's a BL manga and one of the guys grew suddenly taller than the other and is now worried that his boyfriend doesn't want him anymore.