From what I read Madoff didn't seem to, he never actually tried to invest the money and couldn't really have expected his ponzi scheme to become a permanent engine of the economy or anything..

I don't really think that has the moral conclusion people try to imply though. Thinking they could get away with it as a permanent secret gap that no one need ever know about is actually a worse moral character.