Teach on Udemy

Turn what you know into an opportunity and reach millions around the world.

Learn More

Your cart is empty.

Keep shopping

Bash Shell Programming for Data Sciences: Animated Course

Innovative Project-based Animated Linux Command Line Masterclass: Bash Shell Programming Data Mining Science- 7.5 Hours

Created byScientific Programmer™ Team, Scientific Programming School

Last updated 1/2022

English

What you'll learn

Use Bash to quickly sort, search, match, replace, clean and optimise various aspect of a data set
Use bash in processing real-world data sets (included)
Use Bash commands and scripting
Use Regular Expressions (RegEX) in Bash
Use AWK programming language commands to tweak and format data
Use SED and GREP to quickly search in large-scale data sets

Course content

13 sections • 100 lectures • 7h 9m total length

Welcome!0:58
Why Get this Course?1:11
Start from zero and master bash shell programming for data sciences with practical, project-based learning. Benefit from clear video explanations, hands-on exercises, and lifetime access with a 30-day money-back guarantee.
Introduction1:59
In this section, I will introduce you with my Hello Big Data @ Bash course.
Bash may not the best way to handle all kinds of Data! But, there often comes a time when you are provided with a pure Bash environment, such as what you get in the common Linux based super computers and you just want some early results or view of the data before you drive into the real programming, using Python, R and SQL, SPSS, and so on. Expertise in these data-intensive languages also comes at the cost of spending a lot of time on them.
In contrast, bash scripting is simple, easy to learn and perfect for mining textual data! Particularly if you deal with genomics, microarrays, social networks, life sciences, and so on. It
can help you to quickly sort, search, match, replace, clean and optimize various aspect of your data, and you wouldn’t need to go through any tough learning curves. We strongly believe, learning and using Bash shell scripting should be the first step if you want to say, Hello! To Big Data.
Course Organization1:27
This course starts with some practical bash-based flat file data mining projects involving:

University ranking data
Facebook data
Crime Data; and
Shakespeare-era plays and poems data (coming soon!)

If you haven’t used Bash before, feel free to skip the projects and get to the tutorials part. Read the tutorials and then come back to the projects again. The tutorial section will introduce with bash scripting, regular expressions, AWK, sed, grep and so on.

Finally, it gives you a concise beginner friendly guide to the big data landscape including an overview of the critical Big Data tools such as HDFS, MapReduce, YARN, Flume, Hive and more. The book finishes with a near-complete list of references to all the relevant command line and Big data tools.
An Interactive Shell for Practicing Bash and Linux Commands0:36

Linux Terminal20:14
Redirection16:26
Explore redirection with the cat command, learn to redirect and append standard output to files (using > and >>) and standard error (2>) while handling standard input from files (<).
Pipe25:09
Alias11:49
Files and folders17:49
Master creating files and folders with touch, mkdir, and echo redirection; manage spaces and case sensitivity. Harness brace expansion to generate many files and folders in one command.
Wildcards13:37
Learn how wildcards empower Bash commands by building patterns with the star wildcard, the question mark wildcard, and square brackets, enabling flexible file listing and operations via regular expressions.
Delete19:17
Copy and move11:03
Master copying and moving in bash by using cp and mv to duplicate files and folders, rename items, and apply recursive copying with wildcards and proper destinations.
Edit19:48
locate13:41
Learn how the locate command searches a file index with patterns, case-insensitive matching, result limits, and existing or follow checks to validate files and links, updated via sudo.
Find41:14
Learn to use the bash find command for data sciences to search by name, type, and size, control depth with max depth, and execute actions on results.
View20:11
Sort16:34
Archive19:18
Cron21:31
Linux Commands Cheatsheet

Data preview (head command)2:41
Preview the 2017 U.S. News university rankings dataset with bash commands like head, cat, and grep. Identify key columns: name, city, state, tuition and fees, rank.
Find the colleges in the ranklist (grep, pipe and wc)2:29
Find the number of Institutes from a given and all states (cut and sort)2:11
Extract the institute and state columns from the dataset using cut, sort the list, and apply uniq -c to count institutes by state, revealing that California leads.
Finding the correlation between university tuition and ranks (tail and redirect)2:27
explore the correlation between university tuition and ranks by curating a data set, generating a scatterplot, and investigating an outlier, using bash commands for data mining.
Demonstration1:23
Uni rank data project commands demo.
Project documentation0:02
Project Dataset (Unirank)0:02
Bash commands quiz

Data preview (head command)2:00
Learn bash data preview techniques using head, cut, cat, grep, and awk to inspect datasets, count columns and rows, filter patterns, and remove duplicates.
Find the number of status and most popular status entry (cut, sort, grep, awk)3:02
Extract column four with cut, then use awk to sum reactions across columns 8–15, sort by totals, and grep to identify the most popular status entry.
Building a function to find the most vibrant Facebook status (Bash functions)2:17
Demonstration2:59
Facebook Project Demo
Project data set (Facebook like and share data)0:01
Project documentation
Project documentation (how-to)

Data preview (head and csvlook commands)4:13
Finding rows and columns stats (wc, sed, csvstat)3:09
Count rows and columns in data using bash tools—head, sed, wc, csvstat—then sort by the 11th column and use awk to show the top crime by totals via pipes.
Finding the top most crime per city (awk)2:05
Leverage awk in bash to sum crimes by city, implement a top_crime function that reports the top crime for a given city, and compute average crimes.
Finding the best city in Australia (Bash shell programming)2:05
Demonstration2:40
Demonstration of commands used in this project
Project data set (Au Crime data set)0:01
AU crime per city data set (from data.gov.au).
Crimestat.sh source code description1:05
Project documentation
Project documentation

Bash Scripting9:32
Write and run a bash script by adding a shebang and /bin/bash interpreter, then automate tasks like creating a directory, generating 100 files, and logging details to a log file.
Hello! Bash1:02
"Hello World!" Bash Shell Programming0:59
Launch your bash scripting journey with hello world in bash. Explore foundational bash shell programming concepts for data sciences.
Variables1:55
Explore variables in bash with a hello world example, assigning values like 640 and 7.2 and printing them with echo using the dollar sign to reference the variable.
Bash variables and functions1:33
Bash command execution and passing arguments0:16
Bash meta characters1:41
Bash quotation basics0:51
Bash read and store user input0:08
Bash’s built-in read function helps you to read user input and the variable next to read will store the input value. See an example in this lesson. Too easy!
Bash redirections0:31
Conditionals13:53
Learn bash conditionals using arithmetic relational operators for numbers and strings, including if, elif, and else, with proper spacing in [ ], and and/or or operators for complex conditions.
Bash conditional statements1:42
Looping11:31
Arithmatic2:14
Bash `loop` statements1:37
Bash arithmatic operations1:32
Functions6:50
Define and reuse Bash functions to organize code and perform tasks efficiently. Learn to read input, echo results, and pass arguments to functions and scripts, including arithmetic like squaring numbers.
Bash arrays0:33
Project6:17
Download the Bash shell scripting tutorials0:01
Download all the Bash scripting tutorials as a single pdf file.

Requirements

A Linux based operating system installed on your computer

Description

THIS IS THE BEST, MOST INNOVATIVE AND THE HIGHEST RATED AWARD WINNING LINUX COMMAND LINE COURSE (ANIMATED TUTORIALS & LINUX COMMAND LINE HD SCREEN CASTS) ON THE UDEMY PLATFORM. AWESOME FIVE STARS ⭐⭐⭐⭐⭐ VIDEOS OF 7.5 HOURS, ALL UPDATED FOR THE 2022.

This awesome course is specifically designed to show you how to use the Linux commands and Bash shell programming to handle textual data which can be a csv format data or systems log file. In this course you will learn Bash by doing projects.

However, you need to understand the fact that Bash may not the best way to handle all kinds of data! But there often comes a time when you are provided with a pure Bash environment, such as what you get in the common Linux based Super-computers and you just want an early result or view of the data before you drive into the real programming, using Python, R and SQL, SPSS, and so on. Expertise in these data-intensive languages also comes at the price of spending a lot of time on them.

In contrast, bash scripting is simple, easy to learn and perfect for mining textual data! Particularly if you deal with genomics, microarrays, social networks, life sciences, and so on. It can help you to quickly sort, search, match, replace, clean and optimise various aspect of your data, and you wouldn’t need to go through any tough learning curves. We strongly believe, learning and using Bash shell scripting should be the first step if you want to say, Hello Big Data!

Also Featured on! popular Data Analytics Portals! Towards Data Science, Code Burst, Devto and so on.

This course starts with some practical bash-based flat file data mining projects involving:

University ranking data
Facebook data
AU Crime Data
Text Mining with Shakespeare-era Play and Poems

(Data sets and PDF text documentations are provided at the end of each section) + Free interactive playgrounds included!

If you haven’t used Bash before, feel free to skip the projects and get to the tutorials part (supporting materials: eBook). Read the tutorials and then come back to the projects again. The tutorial section will introduce with bash scripting, regular expressions, AWK, sed, grep and so on. Students purchasing this course will receive free access to the interactive version (with Scientific code playgrounds) of this course from the Scientific Programming School (SCIENTIFIC PROGRAMMING IO). Based on your earlier feedback, we are introducing a Zoom live class lecture series on this course through which we will explain different aspects of Linux command line for Data analytics. Live classes will be delivered through the Scientific Programming School, which is an interactive and advanced e-learning platform for learning scientific coding.

MONEY BACK GUARANTEE IF NOT 100% SATISFIED!

When you enroll you will get lifetime access to all of the course contents and any updates and when you complete the course 100% you will also get a Certificate of completion that you can add to your resumé/CV to show off to the world your new-found Linux & Scientific Computing Mastery! So What are you Waiting For? Click that shiny enroll button and we'll See you inside. We created here a total of one university semester worth of knowledge (valued USD $2500-6000) into one single video course, and hence, it's a high-level overview. Don't forget to join our Q&A live community where you can get free help anytime from other students and the instructor. This awesome course is a component of the Learn Scientific Computing master course.

UDEMY EARLY ACCESS PROGRAM REVIEWS (5 out of 5 Stars):

"This is one of the best course I have reviewed in Udemy. All the chapters are very useful. The instructor explained exactly what you need to use Bash as your data analysis tool in your pocket. I look forward more coursed from this Instructor. The instructor is very experienced, explanations are on point. Than you for creating a great course." - Tarique Syed

"The instructor was very engaging. Changed a boring, hard-to-understand tool into something usable and easy-to-use, all the while making it fun to learn." - Prat Ram"Well done. Well - structured and explained course. Will definitely recommend the course to my course. From my point of view, everything was OK in the course." - Sem Milaserdov "Overall, the course delivered what promised with a good resource for those who want to learn and do more. The course is filled with resource and the educator attached his own book on the subject for the learners." - Afshin Kalantari

"It's a very well organized course, from the background, basic Linux cli which everyone should be to build data processing scenarios. wonderful class." - Charley Guan

Who this course is for:

Students who want to learn Bash and the command line to improve their career prospects
Researchers who want to add Bash and other command line tools to their bag of tricks
Scientists who want to learn to explore and analyze the data that their lab generates
Journalists who want to polish their reporting by analyzing publicly-available datasets
Anyone wants to deal with Big Data

Bash Shell Programming for Data Sciences: Animated Course

What you'll learn

Explore related topics

Course content

Course Intro5 lectures • 6min

Tutorial 0: Linux commands16 lectures • 4hr 48min

Project 1: University ranking7 lectures • 11min

Project 2: Facebook6 lectures • 10min

Project 3: Cities crime statistics8 lectures • 15min

Project 4: Plays and poems texts5 lectures • 11min

Tutorial 1: Bash Shell Scripting!20 lectures • 1hr 5min

Tutorial 2: RegEx (Regular Expressions)8 lectures • 5min

Tutorial 3: AWK scripting5 lectures • 4min

Tutorial 4: SED (Stream Editor)4 lectures • 3min

Requirements

Description

Who this course is for: