The place you came from deserves context, not automatic authority over where you go.

Where you started explains a great deal about how you think, what you fear, and what you assume, and that is worth understanding properly. It becomes a problem when it is treated as a verdict on where you are allowed to end up. Origin is context, not permission, and it has no standing to decide your direction.

Separate what your background explains from what it dictates. Keep the explanation, since it is genuinely useful. Decline the second role, politely and repeatedly if necessary.