I reject this premise. A neural network is not a program, they are essentially huge multi-sheet Excel workbooks that compute a score for a given set of inputs.
Unlike the Excel workbooks made by domain experts, it's almost impossible to even find out what the function of any given cell is in the overall computation. See the effort it took to find the "neuron" responsible for a/an differences in GPT-2.[1]
Neural networks have their roles as a black box, but they are not programs, constructed with intent by humans, to be read by other humans, and compilers.
Unlike the Excel workbooks made by domain experts, it's almost impossible to even find out what the function of any given cell is in the overall computation. See the effort it took to find the "neuron" responsible for a/an differences in GPT-2.[1]
Neural networks have their roles as a black box, but they are not programs, constructed with intent by humans, to be read by other humans, and compilers.
[1] https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-a...