There's a balance to be had - and frankly most code has a finite lifetime and developers often put too much priority on making it cleaner than it needs to be. The technical debt metaphor is a good one; a PM should understand that when code isn't clean it increases the cost of making changes to that code, and sometimes that's a price you want to pay and sometimes you don't.