Data science interview questions and answers for 2023

Data Science is an interdisciplinary field that uses scientific methods, algorithms and systems to extract knowledge and insights from structured and unstructured data. It combines the principles and practices from a variety of fields such as mathematics, statistics, computer engineering and more.

The data science life cycle looks something like this:

• First, the problem is defined and the data needed for the problem is outlined.
• After that, the necessary data is collected through various sources.
• Then, the raw data collected is cleaned for inconsistencies and missing values.
• After that, the data is explored and a summary of the insights is collected.
• The cleansed data is then run through different algorithms such as text mining, recognition patterns, predictive analytics, etc.
• Finally, reports, charts, graphs, and other visualization techniques are used to present the results to the business stakeholders

Data science uses various tools and techniques including data analytics to gather meaningful insights and present them to business stakeholders. On the other hand, data analytics is one of the techniques that analyzes raw data to determine trends and patterns. These trends and patterns can help guide businesses in making effective and efficient decisions. Data analytics uses historical and present data to understand current trends. Whereas, data science uses predictive analytics to determine future problems and drive innovations. Answering this data science interview question can distinguish you from the rookies.

Sampling is at the core of data science and hence, this data science interview question gives you the opportunity to display your core knowledge. When the data set is very large in size, it is not feasible to conduct an analysis on the entire data set. In such cases, it is critical to select a sample from the given population and conduct data analytics on the selected dataset. This requires caution as a representative sample that represents the true characteristics of the entire population must be selected. The two main sampling techniques used as per statistical needs are:

• Probability samplings such as cluster sampling, random sampling, and stratified sampling
• Non-probability samplings such as quota sampling, convenience sampling, and snowball sampling

This is an important data science statistics interview question. Let’s outline the differences:

Underfitting: Underfitting means that the statistical model does not fit the existing data set. Underfitting occurs when less training data is provided. The statistical model in underfitting is extremely weak in identifying the relationship in the data and thus, unable to identify any underlying trends. Underfitting can ruin the accuracy of the machine learning model. It can be avoided if more data is used and the number of features is reduced by using feature selection.

Overfitting: A statistical model is overfitted when a lot of data is used to train it. When too much data is used the model learns from the noise and inaccurate data as well, resulting in the inability of the model to categorize the data accurately. Overfitting occurs when non-parametric and non-linear methods are used. Solutions include using a linear algorithm and using parameters such as maximal depth.

Sometimes simple data science interview questions like the above can catch you off-guard, make sure you are prepared with such questions.

When there is an unequal distribution of data across categories, the data is said to be imbalanced. Imbalanced data produces inaccurate results and model performance errors. Additionally, when training a model using an imbalanced dataset, the model pays more attention to the highly populated classes and poorly identifies the less populated classes.

When there is an unequal distribution of data across categories, the data is said to be imbalanced. Imbalanced data produces inaccurate results and model performance errors.

Python is the most popular language for data science, followed by R. This is so because Python provides great functionality for statistics, mathematics and scientific functions. Further, it offers rich libraries for data science applications.

Structured, semi-structured, and unstructured data are the three types of data in big data.

Supervised learning is a type of machine learning where the algorithm is trained on a labeled dataset, either to classify data or predict outcomes.

Volume, Velocity, Variety, Veracity, and Value are the five V’s of big data.

Raw data can be processed more than once. This is often done to clean or transform the data.

MongoDB is a form of a NoSQL database.

Enumeration is a process of assigning a numerical value to each member of a set or group. This can be used to count things or to identify members of a group.

MICE is a data imputation package, which can be used to fill in missing values in data.

Outliers are values that deviate significantly from the rest of the data and are sometimes caused by errors.

Relational databases use a language called SQL (Structured Query Language) that is useful in manipulating data in the database.

Python would be best suited for text analytics because of rich libraries like Pandas.

A P-value greater than 0.5 indicates that the null hypothesis is more likely true than the alternative hypothesis.

Yes, a tuple is an immutable data structure, which means that once it is created, it cannot be modified.

A lambda function has only one expression.

NLP stands for Natural Language Processing, which is a process of extracting information from text data.

Disaggregation of data is the process of breaking down data into smaller, more manageable pieces.

To normalize variables, you need to standardize the data so that each variable has a mean of 0 and a standard deviation of 1.

Deep learning is a subset of machine learning that that enables machines to learn from experience and understand the world in terms of a hierarchy of concepts. Deep learning can be used to build intelligent systems that can make decisions and predictions based on data.

The vertical representation of data is known as column, while the horizontal representation of data is known as rows.

The "K" in K-means algorithm stands for the number of clusters that the algorithm will form. K-means is an unsupervised learning algorithm that clusters data into K distinct clusters.

Variance in data science is a measure of the spread of a dataset. It is calculated by taking the average of the squared differences between each data point and the mean of the dataset.

A primary key is a column in a table that we can use to identify all rows uniquely.

An ensemble learning algorithm which is based on decision trees. Random forest is a machine learning algorithm for classification and regression.

Correlation and covariance are two measures of how two variables are related. Correlation is a measure of how two variables vary together, while covariance is a measure of how two variables vary in relation to each other.

The Hamming distance and the Levenshtein distance are two methods for comparing the distance between two binary strings. The number of bits that differ between two strings is defined as the Hamming distance. The number of edit operations (insert, delete, or replace) required to transform one string into another is represented by the Levenshtein distance.

Tableau supports a variety of data types, including numeric, string, date, and geographic data.

R2 metrics is a statistical measure that represents the proportion of the variance in a data set that is explained by a linear regression model.

There are several ways to measure the accuracy of a model, including the mean squared error, the mean absolute error, and the R-squared value.

Data mining is the process of obtaining useful information from large data sets.

Classification, regression, and clustering are all types of machine learning models. Classification models are used to predict categorical values, regression models are used to predict numerical values, and clustering models are used to group data points into clusters.

When the data accuracy is questionable or there is uncertainty about the parameters of the given population, resampling is done. It is a method to improve the accuracy of the sample data and the quality of the model by training it on different datasets to handle variations.

Yes, this algorithm can be used for both classification and regression.

Descriptive statistics are numerical methods used to summarize and describe a given data set. They are used to quantify the data in order to better understand its characteristics.

Some of the popular sampling bias are - selection bias, under-coverage bias, non-response bias, survivorship bias, availability bias, among others.

Nunique function is an aggregation function in PostgreSQL. It used to calculate the number of unique values in a data set.

Bagging, a machine learning technique, improves the accuracy and stability of models by combining the predictions from multiple models.

Yes, Support Vector Machine or SVM is a classification algorithm.

A decision tree is a tree-like structure where each node represents a decision. The leaves of the tree represent the output of the decision tree.

Data wrangling is the procedure of cleaning and preparing data for analysis.

Univariate analysis has one variable, whereas bivariate analysis has two variables. Univariate analysis is used to describe data and find patterns within it. On the other hand, bivariate data focuses on finding how two variables are related to each other.

The method of creating visual representations of the data is referred to as data visualization.

A Pandas Index is a mutable, ordered set that can be used to index data in a Pandas DataFrame.

Exploratory data analysis (EDA) is an approach to analyzing data sets to summarize their main characteristics, often with visual methods. This involves visualizing the data, computing summary statistics, etc.

Yes. Both have the same meaning.

In exponential smoothing, the sum of weights is equal to 1.

The full form of ANOVA is ‘Analysis of Variance’.

The Central Limit Theorem states that the distribution of the sample will be normal if the sample size is large enough.

The head and tail function is used to return the first or last n elements of a vector, respectively. This can be useful to see the elements at the beginning or end of a dataset.

In machine learning, data augmentation is the process of artificially increasing the size of your training dataset by adding new, modified, or synthetic data samples. This can be done by adding more samples of the existing data, or by synthesizing new samples from the existing data.

The append() method is used to add data to a Panda DataFrame.

There are many advantages to using TensorFlow. Some of the most notable ones include the ability to scale to large datasets, the ability to use GPUs for speed, and the ability to automatically differentiate between various data types.

A skewed distribution occurs when the data in a data set are not evenly distributed.

The range of recall ratio is typically 0 to 1, with higher values indicating a better recall rate.

There are a number of different clustering algorithms, including k-means clustering, hierarchical clustering, fuzzy C-means clustering, density-based clustering, etc.

Yes, Matplotlib is an open-source library.

Through this data science interview question, the interviewer wants to understand whether you have experience handling critical situations. The two main methods of feature selection are wrapper and filter methods.

Wrapper method includes:

• Forward selection: One feature is tested at a time and added till a good fit is achieved
• Backward selection: All features are tested and those not fit are removed to find which fits best.
• Recursive feature elimination: Different features are checked and their pairs are tested to see how they work together recursively.
• Wrapper methods need high-end computers and a lot of labor if the data sets for analysis are huge.

Filter method includes:

• Chi-square
• ANOVA
• Linear discrimination analysis
• Filter methods involve cleaning up the data. In order to select the most suitable features, various statistical methods are used by these filter methods.

This data science interview question establishes your own decision-making prowess. Below are the steps for building a decision tree: For input, take the whole data set

• Calculate the entropy of the class variables and predictor attributes
• Calculate entropy after splitting the attributes
• Calculate information gain of all attribute splits
• Select as root node the attribute with the highest information gain
• Repeat the process for all branches until you finalize the decision node of each branch

For example, if you want to make a decision tree for deciding whether you should buy a certain flat or not, this is how the decision tree may look like:

We can see from the decision tree that the flat will be bought if: The cost of the flat is less than INR 5000000 The premises has walking track, gym, and swimming pool

No, overfitting may occur even if the size of data is not large.

No, hybrid bayesian networks take both continuous and discrete variables as numerical inputs.

Replicated from the neuron of the human brain, neural networks is a technique in AI to teach computers how to process data. They are made up of many interconnected processing nodes, or neurons, that can learn to recognize patterns in input data.

Cross-validation is a method of evaluating a machine learning model by training it on a portion of the data and then testing it on another portion of the data. This allows you to assess the accuracy of the model and avoid overfitting.

Some drawbacks of linear regression model are -

• It can’t capture non-linear relationships between the independent and dependent variables.
• It is sensitive to outlier data sets.
• It cannot be used to predict categorical outcomes.

Bias in a model can be measured by looking at the difference between the predicted values of the model and the actual values of the data. Bias can be caused by factors, such as selection bias and data leakage.

This process is called pruning.

Overfitting is a problem that can occur when a machine learning model is too complex and does not generalize well to new data. Overfitting can be avoided by using regularization methods such as early stopping and cross-validation.

Linear regression is a type of machine learning algorithm that is used to predict continuous values. Logistic regression is a type of machine learning algorithm that is useful in predicting binary values.

Both types of regression can be used with multiple predictors, but the interpretation of the coefficients may be different.

Survivorship bias is a type of cognitive bias that occurs when people only pay attention to information that confirms their preexisting beliefs. This can lead to distorted conclusions about what is true and what isn't.

One way to overcome survivorship bias is to be aware of it. Pay attention to information that goes against your beliefs and try to understand why that information exists. Be open to the possibility that you might be wrong about something and be willing to change your beliefs if new evidence suggests that you should.

A confounding variable is an extraneous variable that interacts with the independent and dependent variables, making it difficult to determine the true effect of the independent variable on the dependent variable.

Precision rate is calculated by dividing the number of true positives (TP) by the sum of the true positives and false positives (FP), like so:

Precision Rate = TP / (TP + FP)

SMOTE - Synthetic Minority Oversampling Technique

Bivariate analysis is the study of two variables. This can involve things like looking at the relationship between them or predicting one variable based on the other.

The K-means algorithm works by partitioning a data set into a number of clusters and then assigning each data point to the cluster that is closest to it.

The gradient is a measure of the steepness of a slope. Gradient descent is a method of minimizing a model's error by determining the best gradient.

Also known as the 80/20 rule, the Pareto principle states that "80% of the effects result from 20% of the causes." In other sayings, a limited number of factors account for a large proportion of the results.

An activation function is a mathematical function that determines the output of a node. The purpose of an activation function is to introduce non-linearity into the network so that it can learn complex relationships.

A chi-square is a statistical test used to determine whether there is a significant difference between two groups/variables.

Yes, logistic regression is a supervised machine learning algorithm that is used to predict the probability of a binary outcome. The output is a value between 0 and 1 that represents the likelihood of the occurrence of the event.

Bias is a term used in machine learning to refer to the error introduced by the simplified assumptions made by the model. A biased model has been oversimplified and does not accurately represent the true relationship between the input and output variables

If we use a ReLU activation and then a sigmoid as the final layer, the output will be a value between 0 and 1. The sigmoid function is used to squash the output of the neurons so that it is interpretable as a probability.

The function of inner join is to combine two or more tables. It returns all rows from the tables that have matching values in the specified columns.

A/B testing is an evidence-based approach to making decisions. A/B testing is a way of comparing two groups of data to see which one is better.

One way to avoid selection bias is to use a randomized sampling technique. This method randomly selects an equal number of cases from each group and then combines the cases into one data set.

PyTorch is a deep-learning framework that is used for building and training neural networks.

Output:

[0, 4, 8, 12]

1/3

σ2=npq

X[:, np.newaxis] + Y

Output:

231

SELECT Name FROM StudentData WHERE Age = ‘18’

SELECT Name FROM StudentData WHERE Department = ‘Bio Tech’ and Age = ‘21’

The probability is 11/216

For:

(X1, Y1) = (4, 5) (X2, Y2) = (3, 2)