
Meet Bharani Kumar de Puru, an industrial revolution 4.0 implementer and chief data scientist, sharing his LinkedIn profile and global leadership across firms for an engaging analytics and edtech session.
Explore the agenda and stages of analytics. Learn how project management methodology frames real-world analytics projects and reveals concepts across modules.
Explore diagnostic analytics by asking why something happened and tagging reasons behind trends, such as sudden increases or decreases in covid-19 cases, including factors like lockdown or vaccination.
Explore predictive analytics by using current data to forecast future outcomes, such as Covid 19 cases or vaccination rates, and assess prediction validity across different time horizons.
Prescriptive analytics uses what if scenarios to explore options and take actions based on predictions, such as increasing vaccines or awareness campaigns, or shutting down blower unit to prevent failures.
Examine the CRISP-ML(Q) framework and its six phases—business and data understanding, data preparation, model building and tuning, evaluation, deployment, and monitoring and maintenance.
Define the scope of application and establish business objectives and constraints to minimize loan defaulters, maximize profits, and apply survival analytics for informed loan approvals.
Define business success criteria and align machine learning goals with KPIs, such as reducing loan defaulters under 5%, balancing accuracy, performance, and return on investment.
Explore business understanding and use cases in supervised learning, examining fraud detection and objective trade-offs between minimizing fraud and maximizing convenience, including drone driven analytics for agriculture.
Explore agenda data understanding by identifying data types and scales of measurement. Clarify key terms and terminologies, and examine primary and secondary data collection techniques.
Understand data understanding by examining data and datum, and see how measuring data enables analysis, modeling, predictions, optimization, and what-if analysis for management decisions.
Explore continuous vs discrete data in supervised learning, learn how decimal representation defines these types, and distinguish numeric, categorical, and count data with real-world examples.
Explore categorical data versus count data, including binary (boolean) and multiple categorical types, with nominal, ordinal, interval, and ratio scales, plus churn and other count-based examples.
Explore practical data understanding through a real-time example, distinguishing nominal, ordinal, interval, and ratio data with flight numbers, gate numbers, temperatures, and money.
Explore the scale of measurement across nominal, ordinal, interval, and ratio data, learn the operations each type supports, and understand why ratio data enables the most comprehensive analysis.
Explain the difference between quantitative and qualitative data with numeric measures and qualitative observations, and show how structured, continuous, and count data guide decision making.
Differentiate structured tabular data from unstructured data like videos, images, audio, and text. Transform unstructured data into structured form via pixel values, mel frequency cepstral coefficient, and bag-of-words.
Explore data collection essentials, distinguishing primary and secondary data sources. Identify common variable terms such as output, input, predictors, and features for structured datasets.
Explore how to identify and leverage primary data sources, including external data like social media data, IoT sensors, and sentiment analysis, to improve supervised ensemble model performance.
Explore secondary and primary data sources, and learn how combining open source maps, drone analytics, and syndicate data with customer data enhances insights for data-driven decisions in telecom and beyond.
Explore end-to-end data collection with surveys by linking business reality to root cause analysis and research objectives, then translate constructs into time, strength, and constraint guided questions.
Explore how design of experiments guides data collection for marketing experiments, analyzing coupon discounts, expiry timing, and customer distance to reveal optimal promotion strategies.
Identify and mitigate data collection errors, from faulty measurement devices and random errors to systematic biases, using standard operating procedures, gauge R&R, and attribute agreement analysis to ensure representative data.
Examine bias and fairness in data science; ensure diverse data and avoid race or gender variables in models. Focus on business understanding and data collection and preparation before developing algorithms.
introduce the crisp-ml-q data preparation framework with six phases, from business and data understanding to objectives, constraints, success criteria, data types, and secondary or primary data collection.
Master the probability formula: number of interested events over total events, and apply it to dice to find outcomes like bigger than three and smaller than four.
Define random variables by combining variability and probability, illustrate with coin flips and die rolls, and explain probability distribution and uppercase and lowercase notation.
Explore fundamental probability concepts and their applications, including probability distribution, random variables, and discrete vs continuous data, with real-world examples from sales data and notable cases.
Understand normal distribution as a continuous probability distribution with height or profit as the random variable. The curve's area equals one, and the probability of any exact value is zero.
Learn how inferential statistics use samples to draw inferences about a population, apply simple random sampling to avoid bias, and plan hypothesis testing with parametric and nonparametric methods.
Explore the standard normal distribution and z-scores. Learn to standardize data using the z-score formula and interpret sigma-level properties.
Examine the three measures of central tendency—mean, median, and mode—and their role in first moment business decisions. Learn how outliers affect the mean, and when to use median or mode.
Explore measures of dispersion and the second moment to assess variation in profits across locations, compare forecasting confidence for Malaysia versus Singapore, and identify outliers using control charts.
Learn how box plots distinguish percentiles, quartiles, and quantiles, including the first, second, and third quartiles and the minimum and maximum values.
Explore how q-q plots assess normality, compare with histograms and box plots, and explain standardized and sample quantiles for determining distribution shape.
Explore bivariate scatter plots to understand direction and strength of correlations between two numeric variables. Interpret linear, non-linear, and polynomial relationships, outliers, and clusters using correlation coefficient R.
Download Python from python.org to install the latest 3.10.7 on any OS, then explore open‑source Python for free use and consider Anaconda for a nicer look.
Learn how to install Anaconda, a cross-platform, OS-agnostic Python distribution with pre-installed libraries, free for individuals but paid for commercial use, helping data scientists avoid library version conflicts.
Explore how Anaconda Navigator and Spyder streamline Python learning, compare IDEs like Jupyter, PyCharm, and Colab, and use pandas to read CSVs into dataframes for analysis.
Explore hands-on use of Jupyter and Google Colab for Python data analysis, including pandas, read_csv, file uploads, and GPU or TPU acceleration, with practical practice tips.
Learn to interpret scatterplots, identify correlation direction and strength, and distinguish linear from non-linear relationships. Explore covariance versus correlation, outliers and clusters, and core data preparation steps used before modeling.
Learn data cleansing through typecasting in Python using pandas, converting columns with astype to object, string, or numeric types, and understanding how data types affect dataset quality.
Learn data cleansing with Python and pandas, using astype to typecast columns and fix data types such as object, integer, and float for effective preprocessing.
Explore how to handle duplicates through record consolidation and removal, understand master data management and data quality, and remove duplicate columns to improve model efficiency.
Identify and remove duplicate records in the mtcars dataset using pandas read_csv and df.duplicated, exploring keep='first' vs 'last' and keep=False options, and drop_duplicates to clean data.
Ensemble techniques play a pivotal role in improving the accuracy and robustness of predictive models in data science. This intermediate-to-advanced level course is designed to provide a comprehensive understanding of ensemble methods and equip participants with the knowledge and skills needed to effectively apply ensemble techniques in real-world scenarios. Through a combination of theoretical concepts, practical implementation, and hands-on projects, participants will explore various ensemble methods and gain insights into their applications, strengths, and limitations.
Course Objectives:
1. Understand the Fundamentals of Ensemble Techniques:
- Gain an in-depth understanding of ensemble methods and their importance in data science.
- Learn about the intuition behind ensemble techniques and their advantages over individual models.
2. Study Bagging and Random Forest:
- Examine bagging as an ensemble technique, including its underlying principles and algorithmic implementation.
- Dive into Random Forest, a popular bagging-based ensemble method, and learn how it improves model performance.
3. Explore Boosting Algorithms:
- Learn about boosting algorithms, such as AdaBoost, Gradient Boosting, and XGBoost, and their iterative nature.
- Understand the boosting process, including weak learner selection, weight adjustments, and error correction.
4. Master Stacking Techniques:
- Study the concept of stacking, also known as stacked generalization, and its role in combining multiple models.
- Explore various stacking architectures, including blending and meta-model approaches.
5. Model Aggregation and Voting:
- Discover different methods of aggregating ensemble predictions, such as majority voting and weighted voting.
- Explore advanced ensemble techniques like stacking with meta-features and stacking with model pruning.
6. Practical Implementation and Case Studies:
- Apply ensemble techniques to real-world datasets and problems.
- Work on hands-on projects to gain practical experience in implementing ensemble methods using Python/R and relevant libraries.
7. Advanced Topics and Recent Developments:
- Gain insights into advanced ensemble techniques, including gradient boosting variants like LightGBM and CATBoost.
- Explore recent research and developments in ensemble methods, such as deep learning ensembles.
8. Ethical Considerations and Best Practices:
- Discuss ethical considerations surrounding ensemble techniques, including biases, fairness, and interpretability.
- Learn best practices for applying ensemble techniques responsibly and effectively.
This course combines lectures, hands-on exercises, and practical projects to provide a comprehensive learning experience. Participants will have access to a dedicated online learning platform where they can access course materials, video lectures, and supplementary resources. Live sessions and discussion forums will foster interaction, collaboration, and the opportunity to seek clarification and guidance from instructors and peers. Participants will have the opportunity to work on real-world case studies and projects, applying ensemble techniques to solve data-driven problems and gain practical insights.
Assessment and Certification:
Participants will be assessed based on their performance in assignments, quizzes, and project submissions throughout the course. Successful completion of the course, including meeting the assessment criteria, will earn participants a certificate of completion. This certificate can be used to showcase their proficiency in ensemble techniques and their ability to apply them in practical settings.