sorry, hard disagree: explainability leads to reproducibility and predictability, leading to control. Unexplainability leads to chaos.
old adage: if a bug can be reproduced then it's only a matter of time before it's understood and fixed. If a bug can't be reliably reproduced (Heisenbugs) then repair time is unbounded.
(that said, humans are perfectly capable of creating inexplicable and irreproducible bugs - for example, in multithreaded code)
There's a difference between a software bug and a probabilistic decision. A bug is by definition unintended behavior. With decision making ("is this comment spam or not?") it's understood that there will be errors and the goal is to minimize them. It may or not be possible to explain exactly why something is or isn't spam, for example. But as long as the error rate is low enough we accept the lack of clear definition.
old adage: if a bug can be reproduced then it's only a matter of time before it's understood and fixed. If a bug can't be reliably reproduced (Heisenbugs) then repair time is unbounded.
(that said, humans are perfectly capable of creating inexplicable and irreproducible bugs - for example, in multithreaded code)