Bhagavad Gita, Chapter 3, Verse 4
By not performing work, none reaches worklessness; and by merely giving up action, no one attains to perfection.
Just quitting isn't the same as growing. Neither path works if you only do the surface version of it.
Stepping back from action doesn't automatically free anyone, and neither does stepping back from the world. Both paths require real inner work, not just the outward gesture of walking away from something.