
Develop an ocr-ner workflow that extracts name, designation, organization, phone, email, and website from business cards, then train a spaCy NER model on cleaned, labeled data.
Master debugging python errors by identifying the problematic line, inspecting variables, and using q&a, screenshots, and online resources to get solutions quickly.
Create a virtual environment in your project folder with python -m venv and name it, for example, docu scat. Activate it via the folder's activation script to confirm successful setup.
Learn practical text cleaning techniques by removing unwanted whitespace and punctuation, normalizing to lowercase, and applying a clean text function to prepare data for analysis.
train a spaCy ner pipeline model using a config file, specify the output directory and the data and test paths, and monitor the training process until completion.
Extract text from a business card image using Tesseract, preprocess it, and feed the text to a named entity recognition model to predict names, phone numbers, emails, and organizations.
Execute the clean text function to finish data preprocessing, normalizing whitespace and punctuation, maintaining a single function, and returning clean text for use in predictions.
Get named entities from an Indian model and visualize results with spaCy displaCy, extracting phone numbers, emails, organizations such as Life Insurance Corporation of India, a person's name, and website.
Tag each word with bio tagging to identify beginning, inside, and outside entities, convert tokens and their span into a dataframe, and extract word-level text using start and end positions.
Learn to extract and visualize text and entity labels by filtering bounding box data, converting coordinates, and drawing green boxes with labels on images using ocr ner techniques.
Train version 2 model for OCR NER by preprocessing data, validating train/test paths, and running training with a config file to produce trained outputs.
Learn how to build a document scanning app using Python and OpenCV, convert documents to a text-friendly form, and apply OCR and spaCy named entity recognition to extract entities.
Resize the input image to a width of 500 while preserving aspect ratio, then apply seven-step image processing pipeline, grayscale conversion, blur, edge detection, morphological transforms, and contour-based blob detection.
Enhance and sharpen the image, convert it to grayscale, apply blur to reduce noise, and use the Canny edge detector to reveal document edges for ocr data extraction.
Create a flask-based app that uses document scanning and OCR-NER to extract text and data from uploaded images, cropping with bounding boxes and displaying fields like name and phone number.
Install the Python package Flask, activate the virtual environment, and run pip install Flask to set up your Flask app.
Design a document scanning web app with a navigation bar, upload flow, and Python-based document detection. Enable coordinate adjustment and text extraction through a named entity recognition model.
This lecture explain the step-1 and step-2 which is design page in html and render the html with flask.
Here we will create the base template in HTML and style the page using Bootstrap 5. This page will be used as base page and will extends same template to all other html using JINGA template inheritance.
URL: https://getbootstrap.com/docs/5.1/getting-started/download/
URL: https://code.jquery.com/
Create an about page by extending the base template with Flask and rendering about.html, showcasing the document scanning app, its computer vision and natural language processing, and data preparation steps.
Preview step 3 of predicting document coordinates in a Flask app, detailing eight substeps: static directory setup, image upload and scan, extracting four points, and returning results via Ajax.
Learn to scan documents with a Python document scanner, resize images, apply brightness and contrast, predict four-point coordinates, and save processed images for OCR workflows.
Explore the limitations of pytesseract, including issues with rotated, skewed, blurred, or handwritten text; ensure minimum image quality (200 dpi, 300x300 px) and discuss preprocessing and alternatives.
Welcome to Course "Intelligently Extract Text & Data from Document with OCR NER" !!!
In this course you will learn how to develop customized Named Entity Recognizer. The main idea of this course is to extract entities from the scanned documents like invoice, Business Card, Shipping Bill, Bill of Lading documents etc. However, for the sake of data privacy we restricted our views to Business Card. But you can use the framework explained to all kinds of financial documents. Below given is the curriculum we are following to develop the project.
To develop this project we will use two main technologies in data science are,
Computer Vision
Natural Language Processing
In Computer Vision module, we will scan the document, identify the location of text and finally extract text from the image. Then in Natural language processing, we will extract the entitles from the text and do necessary text cleaning and parse the entities form the text.
Python Libraries used in Computer Vision Module.
OpenCV
Numpy
Pytesseract
Python Libraries used in Natural Language Processing
Spacy
Pandas
Regular Expression
String
As are combining two major technologies to develop the project, for the sake of easy to understand we divide the course into several stage of development.
Stage -1: We will setup the project by doing the necessary installations and requirements.
Install Python
Install Dependencies
Stage -2: We will do data preparation. That is we will extract text from images using Pytesseract and also do necessary cleaning.
Gather Images
Overview on Pytesseract
Extract Text from all Image
Clean and Prepare text
Stage -3: We will see how to label NER data using BIO tagging.
Manually Labeling with BIO technique
B - Beginning
I - Inside
O - Outside
Stage -4: We will further clean the text and preprocess the data for to train machine learning.
Prepare Training Data for Spacy
Convert data into spacy format
Stage -5: With the preprocess data we will train the Named Entity model.
Configuring NER Model
Train the model
Stage -6: We will predict the entitles using NER and model and create data pipeline for parsing text.
Load Model
Render and Serve with Displacy
Draw Bounding Box on Image
Parse Entitles from Text
Finally, we will put all together and create document scanner app.
Are you ready !!!
Let start developing the Artificial Intelligence project.