
Explore end-to-end data science with Knime through practical, real-life examples. Learn CRISP-DM basics, environment setup, and topics like time series, imbalanced datasets, customer segmentation, and text mining.
Discover Knime as an open-source analytics platform; learn installation, extensions, and integration with R, Python, and Java, and explore server options on Azure and AWS, with use cases across industries.
This course presents a top-down, open-source Knime-driven data science practicum. It starts with the big picture of data science projects and then dives into methods, enhanced by real-life cross-industry cases.
Explore data science project management with SEMMA, KDD, and CRISP-DM, from data selection to modeling and evaluation, within a KNIME-driven end-to-end practicum.
Download Knime from knime.com using the installer for your operating system, then drag the Knime app into the applications folder; allow about 1.35 gigabytes of disk space.
Explore the Knime environment and screens by launching Knime, setting the workspace, and navigating the explorer, node repository, console, and outline as you create your first workflow.
Build your first Knime workflow by creating a data table, configuring nodes, and executing data flow from source to destination, then visualize results with a color manager and scatter plot.
Under this section and lecture we are going to talk about
Welcome to Data Science
Understanding of a workflow
First end-to-end problem: Teaching to the machine
First end-to-end workflow in Knime
Differences between the concepts of Analytics vs Analysis
Types of analytics: Descriptive, Predictive and Prescriptive Analytics
Sample problems for each type of analytics and data science approach for each of them.
Explore categoric and numerical data in Knime, and distinguish nominal, ordinal, interval, and ratio types to guide data understanding, preparation, and modeling.
Explore data access in knime by using file reader, excel reader, and table creator to load and create datasets, configure headers, and prepare data for visualization and preprocessing.
Explore basic data visualization in Knime to discover data behavior and quality, using scatter plots, line plots, and a color manager to analyze height, weight, gender, and stock data.
Learn row filtering and handling missing values, anomalies, and noisy data in Knime to clean datasets before modeling, using range checks and practical data preprocessing techniques.
Explore advanced filtering in Knime using a rule based row filter to combine height, weight, and other rules with and, or, and parentheses for precise data preprocessing.
Explore how to filter data columns using the column filter node in knime, including include/exclude options, type-based selections, and parallel or serial filtering.
Learn to concatenate two data sources in Knime with the concatenate node, matching headers, handling case sensitivity, and managing missing values when combining tables.
Learn to merge data sources in Knime using the joiner to perform inner, left outer, right outer, and full outer joins on IDs to build a unified table.
Learn how to use Knime's group by and aggregation to summarize data, compute means, medians, minimums and maximums, and manage lists and missing values for clear, grouped insights.
Apply formula and string replacer in Knime to harmonize data sources, perform feature engineering, and compute metrics like body mass index.
Explore discretization, quantization, and binning in Knime by splitting numerical data into bins, converting to categorical data, and naming bins using auto binner or manual boundaries.
Learn the metanode concept and data generation in Knime, and explore splitting, merging, and collapsing workflows while generating synthetic data with various data generators.
Master splitting and merging data in Knime with metanodes, using column combiner and cell splitter to create or separate name and address fields from generated datasets.
Encode string labels into numbers via string replacer and string to number converter to enable numeric operations, demonstrating type conversion of sex from f/m to 1/0 and back.
Concepts of Train and Test sets, splitting the data set into two sets and splitting strategies : Random Sampling, Linear Sampling, Take from Top or Spatial Sampling
Problem types by the data type
Explore Bayes theorem and the naive Bayes model, including conditional probability and the assumption of feature independence, and apply them to a Knime practicum with a real dataset.
Explore Knime's naive bayes practicum by building a workflow from scratch, with binning and preprocessing, handling missing values, partitioning data, and evaluating with a confusion matrix and accuracy.
Explore decision tree algorithms, including information gain and the Gini index, and learn to implement them in Knime through a practical practicum.
Build and evaluate a decision tree workflow in Knime, including training/testing split, learner/predictor configuration, and pruning considerations for clearer outcomes.
k-NN algorithm and the eager / lazy learning strategies, hyper parameters and the concept of distance in machine learning
KNN implementation, concept of probabilities for classification.
concept of confidence intervals
Numeric Distances: Manhattan, Euclidean, Minkowski, Chebyshev Distances
String Distances: Levenshtein Distance
Programming Language define distances, matrix distances or date / time distances
SVM Classification and concepts of hard Margin / soft Margin or types of kernels like, linear, polynomial, exponential or radial basis function (RBF).
Apply svm in Knime to classify gender from height and weight using a 66/34 train-test split, exploring linear, polynomial, cubic, and rbf kernels.
Build an end-to-end data science practicum in knime by training naive bayes, decision tree, knn, and svm on the iris dataset, with evaluation and extensions to apriori, clustering, and regression.
Explore logistic regression as a binary classification method powered by the sigmoid (logistic) function, mapping inputs to 0–1 probabilities and using a threshold for class predictions.
Why ARM has an increasing trend and what are the Recommender algorithm or complex event processing?
Practice end-to-end data science with knime by building a transaction dataset, applying apriori, and uncovering frequent item sets and association rules with minimum support.
The course starts with a top down approach to data science projects. The first step is covering data science project management techniques and we follow CRISP-DM methodology with 6 steps below:
Business Understanding : We cover the types of problems and business processes in real life
Data Understanding: We cover the data types and data problems. We also try to visualize data to discover.
Data Preprocessing: We cover the classical problems on data and also handling the problems like noisy or dirty data and missing values. Row or column filtering, data integration with concatenation and joins. We cover the data transformation such as discretization, normalization, or pivoting.
Machine Learning: we cover the classification algorithms such as Naive Bayes, Decision Trees, Logistic Regression or K-NN. We also cover prediction / regression algorithms like linear regression, polynomial regression or decision tree regression. We also cover unsupervised learning problems like clustering and association rule learning with k-means or hierarchical clustering, and a priori algorithms. Finally we cover ensemble techniques in Knime.
Evaluation: In the final step of data science, we study the metrics of success via Confusion Matrix, Precision, Recall, Sensitivity, Specificity for classification; purity , randindex for Clustering and rmse, rmae, mse, mae for Regression / Prediction problems with Knime.
BONUS CLASSES
We also have bonus classes for artificial neural network and deep learning on image processing problems.
Warning: We are still building the course and it will take time to upload all the videos. Thanks for your understanding.