31. What is the difference between a Data Scientist, Data Analyst, and Data Engineer?
- All three roles perform identical tasks with different job titles
- A Data Scientist builds predictive models and extracts insights using ML; a Data Analyst interprets existing data to answer business questions; a Data Engineer builds and maintains data pipelines and infrastructure
- A Data Engineer builds ML models; a Data Scientist manages databases; a Data Analyst writes code
- Data Scientists work only with structured data; Data Engineers work only with unstructured data
Answer : B Explanation: These three roles form the data team backbone. Data Scientists apply statistics, ML, and domain knowledge to extract predictive insights and build models from data. Data Analysts focus on descriptive analytics — querying, visualizing, and reporting on existing data to answer specific business questions using tools like SQL, Excel, and Tableau. Data Engineers design and build the infrastructure and pipelines (ETL processes, data lakes, data warehouses) that collect, store, and deliver data reliably to analysts and scientists. All three roles are essential for a functioning data-driven organization.
32. What is the difference between population and sample in statistics?
- A population is always larger than 1000 records; a sample contains exactly 100 records
- A population is the entire group being studied; a sample is a subset of the population selected to represent it for statistical analysis
- A sample contains more accurate data than the entire population
- Population refers to people only; a sample refers to any type of data
Answer : B Explanation: In statistics, the Population is the entire collection of individuals or observations about which conclusions are to be drawn. Since studying the entire population is often impractical (too large or costly), a Sample — a manageable subset selected from the population — is studied instead. Conclusions from the sample are then generalized to the population through statistical inference. Key measures differ: population uses parameters (μ for mean, σ for standard deviation) while samples use statistics (x̄ for sample mean, s for sample standard deviation). Representative sampling is crucial for valid conclusions.
33. What is hypothesis testing in data science and statistics?
- A method for testing whether a machine learning model’s hypothesis is correct
- A statistical method used to make inferences or draw conclusions about a population by testing an assumption (hypothesis) using sample data
- A technique for generating hypothetical datasets when real data is unavailable
- A process for selecting the best hypothesis from a list of candidate models
Answer : B Explanation: Hypothesis testing is a formal procedure for testing whether an assumption about a population is supported by sample data. The process involves: (1) Formulating a Null Hypothesis (H₀) — the default assumption to be tested, (2) Formulating an Alternative Hypothesis (H₁) — what you want to prove, (3) Choosing a significance level (α, commonly 0.05), (4) Computing a test statistic, (5) Calculating the p-value, (6) Deciding to reject or fail to reject H₀. Hypothesis testing is foundational to A/B testing, clinical trials, and any data-driven decision-making.
34. What is a p-value in statistics and data science?
- The probability that the null hypothesis is true
- The probability of obtaining results at least as extreme as the observed results, assuming the null hypothesis is true — a small p-value suggests evidence against the null hypothesis
- The percentage of variance explained by a statistical model
- The predicted probability output of a classification model
Answer : B Explanation: The p-value is the probability of obtaining a test statistic as extreme or more extreme than what was observed, assuming the null hypothesis (H₀) is true. A small p-value (typically ≤ 0.05) means the observed data is unlikely under H₀ — providing evidence to reject H₀. A large p-value means the data is consistent with H₀. Importantly, the p-value does NOT tell you the probability that H₀ is true, nor the probability the result will replicate. Misinterpretation of p-values is one of the most common statistical errors in data science and research.
35. What is the Central Limit Theorem (CLT) in statistics?
- A theorem stating that all data in nature follows a normal distribution
- A theorem stating that the sampling distribution of the sample mean approaches a normal distribution as the sample size increases, regardless of the population’s distribution
- A theorem that defines the central tendency measures (mean, median, mode) of any dataset
- A limit on the number of variables that can be included in a statistical model
Answer : B Explanation: The Central Limit Theorem (CLT) is one of the most important results in statistics. It states that when you take sufficiently large random samples (typically n ≥ 30) from any population — regardless of the population’s distribution (normal, skewed, uniform, etc.) — the distribution of sample means will approximate a normal distribution with mean equal to the population mean and standard error = σ/√n. The CLT is the foundation for hypothesis testing, confidence intervals, and statistical inference, making it the cornerstone of data science statistical reasoning.
36. What is the difference between Type I and Type II errors in hypothesis testing?
- Type I error is a math error; Type II error is a logic error in statistical analysis
- Type I error (False Positive) is rejecting a true null hypothesis; Type II error (False Negative) is failing to reject a false null hypothesis
- Type I error occurs in training data; Type II error occurs in test data
- Both Type I and Type II errors refer to the same concept with different severity levels
Answer : B Explanation: Type I Error (α — significance level) is a False Positive — rejecting H₀ when it is actually true. Example: concluding a drug works when it actually doesn’t. The probability of making a Type I error is controlled by setting α (typically 0.05). Type II Error (β) is a False Negative — failing to reject H₀ when it is actually false. Example: concluding a drug doesn’t work when it actually does. Power (1-β) is the probability of correctly rejecting a false H₀. There is typically a trade-off: reducing α (Type I error) increases β (Type II error). Which error is more serious depends on the context.
37. What is the normal distribution (Gaussian distribution) in data science?
- A distribution that is always skewed to the right, with most values concentrated near the maximum
- A symmetric, bell-shaped probability distribution defined by its mean (μ) and standard deviation (σ), where approximately 68%, 95%, and 99.7% of data falls within 1, 2, and 3 standard deviations of the mean
- A distribution used exclusively for counting occurrences of rare events
- A uniform distribution where all values have equal probability of occurring
Answer : B Explanation: The Normal (Gaussian) distribution is the most important probability distribution in statistics and data science. It is perfectly symmetric and bell-shaped around its mean. The 68-95-99.7 Rule (Empirical Rule): ~68% of data falls within ±1σ, ~95% within ±2σ, ~99.7% within ±3σ. Many natural phenomena follow this distribution (heights, IQ scores, measurement errors). Many statistical methods assume normality. The standard normal distribution has μ=0 and σ=1. Data scientists test for normality using Q-Q plots, the Shapiro-Wilk test, or the Kolmogorov-Smirnov test.
38. What is the purpose of Exploratory Data Analysis (EDA) in data science?
- To explore and test multiple machine learning models before selecting the best one
- To analyze and summarize a dataset’s main characteristics using statistics and visualization, discovering patterns, spotting anomalies, checking assumptions, and forming hypotheses before modeling
- To explore new data collection methods and survey designs for future studies
- A final step in the data science pipeline performed after model deployment
Answer : B Explanation: EDA (Exploratory Data Analysis), coined by statistician John Tukey, is the critical first step in any data science project. It involves: understanding data shape and types (.info(), .describe()), checking for missing values and duplicates, analyzing distributions (histograms, box plots), finding correlations (correlation matrix, scatter plots), detecting outliers (IQR method, Z-score), and identifying patterns. EDA helps data scientists understand what the data is telling them before applying any models, preventing garbage-in-garbage-out issues. It guides all subsequent preprocessing and modeling decisions.
39. What is the difference between correlation and causation in data science?
- Correlation and causation are the same — if two variables are correlated, one must cause the other
- Correlation means two variables move together statistically but does not imply that one causes the other; causation means a change in one variable directly causes a change in another
- Causation is measured by Pearson’s coefficient; correlation is measured by regression analysis
- Both terms apply only to categorical variables in statistical analysis
Answer : B Explanation: One of the most critical principles in data science: “Correlation does not imply causation.” Two variables can be correlated (move together) due to: Direct causation, A common third variable (confounding variable), or Pure coincidence (spurious correlations). For example, ice cream sales and drowning rates are correlated — but ice cream doesn’t cause drowning (both are caused by hot weather). Establishing causation requires controlled experiments (randomized controlled trials) or causal inference methods (instrumental variables, difference-in-differences). Confusing correlation with causation leads to seriously flawed business decisions.
40. What is the Pandas library and why is it important for data science?
- A Python library for building and training deep learning neural networks
- An open-source Python library that provides fast, flexible, and expressive data structures (Series and DataFrame) for data manipulation, cleaning, and analysis
- A data visualization library for creating interactive charts and dashboards
- A Python library specifically designed for statistical hypothesis testing
Answer : B Explanation: Pandas is the most essential Python library for data science and data analysis. It provides two core data structures: Series (one-dimensional labeled array) and DataFrame (two-dimensional labeled table, like a spreadsheet or SQL table). Key capabilities: reading/writing CSV, Excel, SQL, and JSON files; data cleaning (handling missing values, duplicates, data type conversion); data transformation (merging, joining, reshaping, grouping); filtering and selecting data; and applying functions across columns/rows. Pandas is the foundation of almost every data science workflow in Python, sitting between raw data and machine learning models.
