Every decision is being critiqued by the PM before it's even a flushed out idea to the point of frustration.

That sounds like a very bad reason to quit and be frustrated. Designers have to be good at dealling with push back, evangelizing their ideas and convincing stakeholders.