{"id":1317,"date":"2021-12-05T06:42:03","date_gmt":"2021-12-05T06:42:03","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2021\/12\/05\/ml-in-manufacturing-detecting-defects-with-unsupervised-learning-and-image-feature-extraction\/"},"modified":"2021-12-05T06:42:03","modified_gmt":"2021-12-05T06:42:03","slug":"ml-in-manufacturing-detecting-defects-with-unsupervised-learning-and-image-feature-extraction","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2021\/12\/05\/ml-in-manufacturing-detecting-defects-with-unsupervised-learning-and-image-feature-extraction\/","title":{"rendered":"ML in Manufacturing: Detecting Defects with Unsupervised Learning and Image Feature Extraction"},"content":{"rendered":"
\n

A while ago, when I was studying at the university, my professor shared a nice story about a fruit import and export company that was concerned about their quality control system for watermelons, which was starting to falter. Some watermelons that weren\u2019t yet ready to be consumed were escaping their controls. I immediately thought the reason would be data drift or overfitted models, thus, they would need to retrain their Machine Learned models. However, my professor mentioned that their quality control system was, in fact, an 80-year old man who had the amazing ability to know if a watermelon was ready to be consumed only by hitting it and listening to the sound the watermelon made. Although I found this way of working was pretty peculiar, this quality control system could also use some data-driven insights that would lead to some room for improvement.<\/p>\n

Quality control remains an issue for many companies. Even subtle variances during processes in assembly lines can cost companies huge amounts of money down the line. Fortunately, BigML can help with that. In this post, we will show how to use image feature extraction and unsupervised learning to find defects in images from a manufacturing process<\/strong>. Specifically, we will focus on the casting process. Casting is a manufacturing process in which a liquid material is usually poured into a mold, which contains a hollow cavity of the desired shape, and then allowed to solidify.<\/p>\n

\"\"<\/figure>\n

Using Anomaly Detection to Find Casting Defects<\/h2>\n

The dataset we\u2019re going to use, originally from Kaggle user ravirajsinh45<\/strong><\/a>, contains several images of pump impellers that were made using metal casting. For this example, we will use a reduced version of that dataset with just 112 images, which can be found here<\/a><\/strong>. Common pump impellers look like this:<\/p>\n

\"4
Pump impellers with no defects<\/figcaption><\/figure>\n

Out of those 112 images, 106 are fine but the remaining 6 pump impeller images contain some defects <\/strong>that render them unusable since they look as below:\u00a0<\/p>\n

\n
\"6
Defective pump impellers<\/figcaption><\/figure>\n<\/div>\n

Please note that those defects are sometimes tiny and hard to catch by a human eye, but BigML can greatly help us in this task. We first upload the .zip file with the images. Since good\/bad <\/em>images are already separated into folders, BigML automatically labels all instances in our composite source<\/strong><\/a>. If you need a refresher, feel free to read our Image Labeling blog post<\/strong><\/a> for more details.<\/p>\n

\n
\"BigML
BigML Composite Source view<\/figcaption><\/figure>\n<\/div>\n

Before creating the dataset, we need to modify the default Image Analysis options from our composite source. As this is a complex problem with many possible kinds of subtle defects, we prefer to use the Histogram of gradients<\/strong> and MobilenetV2<\/strong> as feature extractors:<\/p>\n

\"BigML
BigML Image analysis view in Source configuration<\/figcaption><\/figure>\n

We then update the source and create a dataset (note that the source is automatically closed as we do so).\u00a0As mentioned above, we\u2019re working with a highly imbalanced dataset, with only 6 bad (defective) instances out of the 112 total images<\/strong>.<\/p>\n

\"Casting
Casting dataset within BigML<\/figcaption><\/figure>\n

Next up, we just create a 1-Click Anomaly<\/strong> Detector<\/strong> and\u2026 voil\u00e0! <\/em> Our 6 defective pump impellers will appear within the Top-7 Anomalies<\/strong>!<\/p>\n

\"\"<\/figure>\n

Why Unsupervised Learning?<\/h2>\n

If we tried to solve this problem with a supervised model, we would have to deal with a highly imbalanced <\/strong>dataset. As such, this task would be very time-consuming because trying to create a robust model, without overfitting, from a training dataset that contains only 6 instances from one of its classes is clearly not an easy task.<\/p>\n

Additionally, in most manufacturing processes, we may find a wide variety of defects of a different kind, and some of them can be due to faults in machines that we have never seen before. Therefore, we can\u2019t just train a supervised model with historically labeled images of faults. <\/p>\n

Unsupervised learning models help us to find patterns in data, even without labels!<\/p>\n

Beyond Image Classification and Object Detection<\/h2>\n

When thinking about Convolutional Neural Networks<\/strong><\/a>, people sometimes forget that you can imagine them as a trainable feature extractor <\/em>plus a classifier\/regressor (referring to the readout layer at the end of the network). If you take only the first part, you will have a great tool to transform raw images into the expected tabular<\/em> form that BigML models expect<\/strong>. After applying the desired feature extractors to our image datasets we have datasets ready to be consumed by any of the supervised and unsupervised models that BigML offers<\/strong>. With this approach, the sky is the limit!<\/p>\n

That\u2019s exactly what we have seen in today\u2019s example and there are plenty of use cases where doing unsupervised learning with image extracted features can be the key to solving a real-life business problem. Some fine examples where applying unsupervised learning techniques can have a great impact involve images from security cameras. Using Anomaly Detectors, one can detect uncommon events (e.g., fires, intrusions, etc.). Another example would be Cluster Analysis, which is very useful to find related images so that users can order their personal digital image libraries by grouping related pictures.<\/p>\n

Can you imagine more examples like the above? Feel free to share them with us. Or, even better, we encourage you to try them yourself with the BigML platform!<\/p>\n

Do you want to Know more about Image Processing?<\/h2>\n

Please\u00a0visit the dedicated release page<\/strong><\/a>\u00a0for a gentle introduction to Image Processing and\u00a0join the FREE live webinar on Wednesday, December 15<\/strong> at 8:30 AM PST \/ 10:30 AM CST \/ 5:30 PM CET. Register today<\/a><\/strong>, space is limited!<\/p>\n

Finally, stay tuned for the upcoming blog posts about\u00a0Image Processing<\/a><\/strong> with more examples and tutorials on how to use Image Processing through the API, WhizzML, and the Python Bindings, as well as how this new feature has been implemented on the BigML platform.<\/p>\n

\n
\n

Like this:<\/h3>\n

Like<\/span><\/span> Loading…<\/span><\/p>\n

<\/span><\/a><\/div>\n

Relacionado<\/em><\/h3>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blog.bigml.com\/2021\/12\/03\/ml-in-manufacturing-detecting-defects-with-unsupervised-learning-and-image-feature-extraction\/<\/p>\n","protected":false},"author":0,"featured_media":1318,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/1317"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=1317"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/1317\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/1318"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=1317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=1317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=1317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}