I'm not sure if this is the type of criticism you were looking for, but I found the paper Concrete Problems in AI Safety fairly interesting. It points out a number of ways modern ML systems, especially RL, could be prone to accident risk: reward hacking, distributional shift, etc.
zfurman t1_iry959d wrote
Reply to [D] Looking for some critiques on recent development of machine learning by fromnighttilldawn
I'm not sure if this is the type of criticism you were looking for, but I found the paper Concrete Problems in AI Safety fairly interesting. It points out a number of ways modern ML systems, especially RL, could be prone to accident risk: reward hacking, distributional shift, etc.