Bhagavad Gita, Chapter 2, Verse 33

But if you refuse to engage in this righteous war, then, giving up your own duty and honour, you will incur sin.

Walking away from this fight, right now, isn't neutral. It carries its own kind of consequence.

Refusing a genuine duty isn't the same as staying innocent. Krishna is clear that backing out here carries real consequences, not just for others but for Arjuna himself.