If we go by the facts then every day 2.5 Quintillion Bytes of Data is created in the world. This data also has the repetitive and erroneous records which we need to remove before mining it for insights in it. Inaccurate Data leads to wrong assumptions and analysis ultimately leading to failure of the project. […]

In some broader sense, the epistemological notion of ground truth could apply to any machine-learning approach, if taken to mean the prior understanding of what sorts of patterns the algorithm is trained to search for. The truths being distilled from the data are those consistent with what domain experts—tutors—or quantitative experts—for example, statisticians, mathematicians, and […]

A professor of cognitive science argues that the world is nothing like the one we experience through our senses. Source: The Case Against Reality

How to work with a data science teamBefore diving into the relationship between data science and data engineering teams, I want to briefly define the roles. A data scientist is typically someone with a math and probability background, who also knows how to program. Data scientists are often familiar with big data technologies, in order […]

Recently, Caliskan and colleagues published a paper in Science, that finds as a computer teaches itself English, it becomes prejudiced against black Americans and women.Basically, they used a common machine learning program to crawl through the internet, look at 840 billion words, and teach itself the definitions of those words. The program accomplishes this by […]

Of course, technology is important. Modern civilization wouldn’t be what it is without it. But what amplification implies is that especially in a world of incredible technologies, further progress requires change in people. Without improvements in our collective intention, discernment and self-control — without better heart, mind and will — we won’t use the fruits […]

There are several theories that say every story known to man can be reduced to one of just a handful of archetypes—a quest, overcoming the monster, rebirth, to name a few—but there’s no consensus on what those stories are. In this case, researchers picked six from a mix of popular lists based on what shapes […]

Natural language processing (NLP) is an exciting field in data science and artificial intelligence that deals with teaching computers how to extract meaning from text. In this guide, we’ll be touring the essential stack of Python NLP libraries. These packages handle a wide range of tasks such as part-of-speech (POS) tagging, sentiment analysis, document classification, topic […]

Advances in Natural Language Processing (NLP): Though not quite as hyped as AI, NLP has advanced from basic applications such as speech recognition, speech synthesis and machine translation to a range of real-world applications such as creating spoken dialogue systems and speech-to-speech translation engines, mining social media for information about health or finance and identifying […]

We live in exciting times. A new wave of systems is emerging that apply machine learning, AI, Natural Language Processing (NLP) and more to provide more effective solutions.  Plus, there is a strong incentive for marketers to overhype technology that can’t be made black and white, and to deliberately coin terms or use them in […]