Manufactures & Factories
❯
Product improvement
❯Information extraction from hand-marked industrial inspection sheets
AI solution to quickly identify defects during quality assurance process on wind turbine blades
AI decryption of magnetograms
Leveraging AI to enhance adhesive quality
Improvement of productivity of semiconductor manufacturing
Generative design of mechanical parts
Automatic classification tool for full size core
Information extraction from hand-marked industrial inspection sheets
Optimization of ferroalloy consumption for a steel production company
New machine-learning simulations reduce energy need for N95 mask fabrics
AI solution to calculate amount of contained material from mass spectrometry measurement data
Information extraction from hand-marked industrial inspection sheets
For:
Manufacturing companies, machine inspectors, engineersProblem addressed
To create a pipeline to build an information extraction system for machine
inspection sheets, by mapping the machine zones to the handwritten code using
state-of-the-art deep learning and computer vision techniques.
Scope of use case
Localization and mapping of machine zones, arrows and text, to extract
information from manually tagged inspection sheets.
Description
In order to effectively detect faults and maintain heavy
machines, a standard practice in several organizations is to
conduct regular manual inspections. The procedure for
conducting such inspections requires marking of the
damaged components on a standardized inspection sheet,
which is then camera-scanned. These sheets are marked for
different faults in corresponding machine zones using hand-
drawn arrows and text. As a result, the reading environment
is highly unstructured and requires a domain expert while
extracting the manually marked information.
We have proposed a novel pipeline to build an information
extraction system for such machine inspection sheets,
utilizing state-of-the-art deep learning and computer vision
techniques. The pipeline proceeds in the following stages:
(1) localization of different zones of the machine, arrows and
text using a combination of template matching, deep learning
and connected components, and (2) mapping the machine
zone to the corresponding arrow head and the text segment
to the arrow tail, followed by pairing them to get the correct
damage code for each zone.
The proposed method yields an accuracy of 83,2 % at the end
of the pipeline. The organization has two million such sheets
that are manually processed. This project would enable
considerable savings in terms of time and manpower as it
takes roughly 5 min per sheet for the manual process. The AI
system would process a sheet in 20 s and can be parallelized
for further speed-up.