No one really knows how the most advanced algorithms do what they do. That could be a problem.
There’s already an argument that being able to interrogate an AI system about how it reached its conclusions is a fundamental legal right. Starting in the summer of 2018, the European Union may require that companies be able to give users an explanation for decisions that automated systems reach.
Source: There’s a big problem with AI: even its creators can’t explain how it works
