Step by Step Approach to Principal Component Analysis using Python

Principal Component Analysis or PCA is used for dimensionality reduction of the large data set. In my previous post A Complete Guide to Principal Component Analysis – PCA in Machine Learning , I have explained what is PCA and the complete concept behind the PCA technique. This post is in continuation of previous post, However if you have the basic understanding of how PCA works then you may continue else it is highly recommended to go through above mentioned post first.

Continue reading “Step by Step Approach to Principal Component Analysis using Python” →
Advertisements

A Complete Guide to Principal Component Analysis – PCA in Machine Learning

Principal Component Analysis or PCA is a widely used technique for dimensionality reduction of the large data set. Reducing the number of components or features costs some accuracy and on the other hand, it makes the large data set simpler, easy to explore and visualize. Also, it reduces the computational complexity of the model which makes machine learning algorithms run faster. It is always a question and debatable how much accuracy it is sacrificing to get less complex and reduced dimensions data set. we don’t have a fixed answer for this however we try to keep most of the variance while choosing the final set of components.

Continue reading “A Complete Guide to Principal Component Analysis – PCA in Machine Learning” →

How to Use LinkedIn to Drive Traffic to Your Blog

Linkedin is a professional networking platform. where employers and employees can connect to each other. LinkedIn had 630 million registered members in 200 countries as of june 2019. And 2 new members join LinkedIn per second. These numbers are larger than the population of some of the countries.

Continue reading “How to Use LinkedIn to Drive Traffic to Your Blog” →

What is Logistic Regression?

Logistic regression is the most widely used machine learning algorithm for classification problems. In its original form it is used for binary classification problem which has only two classes to predict. However with little extension and some human brain, logistic regression can easily be used for multi class classification problem. In this post I will be explaining about binary classification. I will also explain about the reason behind maximizing log likelihood function.

Continue reading “What is Logistic Regression?” →

What is Multicollinearity?

Multicollinearity occurs in a multi linear model where we have more than one predictor variables. So Multicollinearity exist when we can linearly predict one predictor variable (note not the target variable) from other predictor variables with significant degree of accuracy. It means two or more predictor variables are highly correlated. But not the vice versa means if there is low correlation among predictors then also multicollinearity may exist.

Continue reading “What is Multicollinearity?” →

What is stepAIC in R?

In R, stepAIC is one of the most commonly used search method for feature selection. We try to keep on minimizing the stepAIC value to come up with the final set of features. “stepAIC” does not necessarily means to improve the model performance, however it is used to simplify the model without impacting much on the performance. So AIC quantifies the amount of information loss due to this simplification. AIC stands for Akaike Information Criteria.

Continue reading “What is stepAIC in R?” →

Feature Selection Techniques in Regression Model

Feature selection is a way to reduce the number of features and hence reduce the computational complexity of the model. Many times feature selection becomes very useful to overcome with overfitting problem. It helps us in determining the smallest set of features that are needed to predict the response variable with high accuracy. if we ask the model, does adding new features, necessarily increase the model performance significantly? if not then why to add those new features which are only going to increase model complexity.

Continue reading “Feature Selection Techniques in Regression Model” →

Important Use Cases of NLP

In today’s world we are generating large amount of data every second. while tweeting, chating, writing or even speaking, we are fabricating corpse of data. Most of the data is in textual and unstructured form. Hence to make this data understandable by computer, we need to process it. NLP technique helps us in processing the data and helps us to get useful insights from it.

Read mor

Basic Statistics for Data Science – Part 1

The Science of collecting, organizing, presenting, analyzing and interpreting the data is statistics. It is one of the most important disciplines or methods to get a deeper insight into data. Statistical analysis is implemented to manipulate, summarize and investigate data so that useful information can be obtained.populationvssample

Take away from this post:

  • Types of Statistics: Descriptive vs Inferential
  • Basic terminology like Population vs Sample
  • Types of Variables: Numerical vs Categorical
  • Measures of central tendencies: Mean, Median and Mode and their specific use cases
  • Measures of dispersion/spread: Variance, standard deviation etc.

Continue reading “Basic Statistics for Data Science – Part 1” →

What is the Coefficient of Determination | R Square

The coefficient of Determination is the direct indicator of how good our model is in terms of performance whether it is accuracy, Precision or Recall. In more technical terms we can define it as The Coefficient of Determination is the measure of the variance in response variable ‘y’ that can be predicted using predictor variable ‘x’. It is the most common way to measure the strength of the model.

Continue reading “What is the Coefficient of Determination | R Square” →

Employee Attrition Rate Analysis – Insights from IBM HR Data

Storytelling or presenting insights is the most important part of data analytics. This is the selling point of all your hard work. Doesn’t matter how much hard work you have put in developing analytic model until you are able to get the attention of the target audience. Here in this particular article, my focus is on how we can use beautiful graphs to show the insights regarding employee attrition rate from IBM HR Attrition data. After all, a picture is worth to thousands of words.

Continue reading “Employee Attrition Rate Analysis – Insights from IBM HR Data” →

What is Linear Regression? Part:1

Linear Regression is a field of study which emphasizes on the statistical relationship between two continuous variables known as Predictor and Response variables. (Note: when there are more than one predictor variables then it becomes multiple linear regression.)

  • Predictor variable is most often denoted as x and also known as Independent variable.
  • Response variable is most often denoted as y and also known as Dependent variable.
Continue reading “What is Linear Regression? Part:1” →