Re: Goal of AI: Perfect or Bounded Rationality

[quote]Thus I do not believe morality is an irrational behavior
when we are unable to make a more reasoned decision.

Because of our limitations and the complexity of the
world we have a set of emotions that guide us most
of the time toward optimal behavior both against the
elements (such as fear of heights) and toward our
fellow human being (caring for each other under
certain circumstances). [/quote]

But a situation where one can steal from one's neighbor is not a case
of our limitations or the complexity of the world. One can easily steal
and gain something, but chooses not to do so. That seems to be
irrational behavior.

You can say that one does not steal due to fear of punishment, but how
does that apply to AI? How do you punish machines? In fact, a machine
may not even understand pain despite being intelligent.

So how to explain irrational behavior such as the above example?

.