DL currently is an experimental science. That is, DL capabilities are actually discovered by researchers by surprise. There are certainly a lot of engineering that goes into the optimization and improvement of these machines. However, its capabilities are ‘unreasonably effective’, in short, we don’t have very good theories to explain its capabilities.It is clear that there are gaps in understanding [...]

Source: Cartoon: Watson and Artificial vs Natural Intelligence

verbal explanations of complex machine learning models can potentially mislead users. Take linear models again as an example. Looking at which features get high weight, absent broader context, might yield dubious interpretations. What if one weight is high, but it's for a feature which takes the same value 95% of the time? In this case, this weight may not be [...]