Tom Merritt explains the five ways human error can create issues with machine learning.
Machine learning (ML). We often focus on the machine part of it, but let's think about the learning. Who do machines learn from? Okay, Generative Adversarial Network (GAN) people--sometimes from each other. But at the start, even GANs learn from data provided by humans; sometimes we pollute that data, just a little. Here are five ways humans bias machine learning.
- The square peg bias. This is where you just choose the wrong data set because it's what you have. For example: You want model sportswear purchases for your online clothing store, but you only have data on what people have been buying at brick-and-mortar shops.
- Sampling bias. You choose your data to represent an environment. Generally, you choose a subset of data that is large and representative, but you have to watch out for the human biases in picking that data; it can be as innocent as forgetting to include nighttime data in a training set for facial recognition.
- Bias-variance trade-off. You may cause bias by overcorrecting for variance. If your model is too sensitive to variance, small fluctuations could cause it to model random noise. Too much bias to correct this could miss complexity.
- Measurement bias. This is when the device you use to collect the data has bias built in, like say a scale that incorrectly overestimates weight; so the data is sound, and no statistical correction would catch it. Having multiple measuring devices can help prevent this.
- Stereotype bias. You're training a machine learning algorithm to recognize people at work, so you give it lots of images of male doctors and women teachers. This might even be mathematically sound, since the stereotype is social and might exist in the data without you even getting involved. But if you want a stronger ML, you'll need to correct for that social stereotype.
SEE: Free machine learning courses from Google, Amazon, and Microsoft: What do they offer? (Tech Pro Research)
Recognizing that the machines are only as good as their masters is essential to getting useful data out of them. And, you know, keeping them from getting mad at how badly we messed them up as children.
- The impact of machine learning on IT and your career (free PDF) (TechRepublic)
- How to become a machine learning engineer: A cheat sheet (TechRepublic)
- What is machine learning? Everything you need to know (ZDNet)
- Machine learning is about to transform these industries (TechRepublic)
- Four ways machine learning is evolving, according to Facebook's AI engineering chief (TechRepublic)
- Amazon's free training: Internal machine-learning courses are now open to all (ZDNet)
- Google ponders the shortcomings of machine learning (ZDNet)
- Machine Learning (TechRepublic Flipboard magazine)