Regression analysis by example / Samprit Chatterjee, Ali S. Hadi.
By: Chatterjee, Samprit
.
Contributor(s): Hadi, Ali S
.
Material type:
BookSeries: Wiley series in probability and statistics: Publisher: Hoboken, New Jersey : Wiley, 2012Edition: Fifth edition.Description: xv, 393 pages : illustrations ; 27 cm.Content type: text Media type: unmediated Carrier type: volumeISBN: 9780470905845 .Subject(s): Regression analysis| Item type | Current library | Call number | Copy number | Status | Barcode | |
|---|---|---|---|---|---|---|
| General lending | MTU Bishopstown Library Lending | 519.536 (Browse shelf(Opens below)) | 1 | Available | 00170169 |
Browsing MTU Bishopstown Library shelves, Shelving location: Lending Close shelf browser (Hides shelf browser)
Enhanced descriptions from Syndetics:
Praise for the Fourth Edition:
"This book is . . . an excellent source of examples for regression analysis. It has been and still is readily readable and understandable."
--Journal of the American Statistical Association Regression analysis is a conceptually simple method for investigating relationships among variables. Carrying out a successful application of regression analysis, however, requires a balance of theoretical results, empirical rules, and subjective judgment. Regression Analysis by Example, Fifth Edition has been expanded and thoroughly updated to reflect recent advances in the field. The emphasis continues to be on exploratory data analysis rather than statistical theory. The book offers in-depth treatment of regression diagnostics, transformation, multicollinearity, logistic regression, and robust regression.
The book now includes a new chapter on the detection and correction of multicollinearity, while also showcasing the use of the discussed methods on newly added data sets from the fields of engineering, medicine, and business. The Fifth Edition also explores additional topics, including:
Surrogate ridge regression Fitting nonlinear models Errors in variables ANOVA for designed experimentsMethods of regression analysis are clearly demonstrated, and examples containing the types of irregularities commonly encountered in the real world are provided. Each example isolates one or two techniques and features detailed discussions, the required assumptions, and the evaluated success of each technique. Additionally, methods described throughout the book can be carried out with most of the currently available statistical software packages, such as the software package R.
Regression Analysis by Example, Fifth Edition is suitable for anyone with an understanding of elementary statistics.
Includes index.
Introduction -- Simple linear regression -- Multiple linear regression -- Regression diagnostics: detection of model violations -- Qualitative variables as predictors -- Transformation of variables -- Weighted least squares -- The problem of correlated errors -- Analysis of collinear data -- Working with collinear data -- Variable selection procedures -- Logistic regression -- Further topics.
This Fifth Edition has been expanded and thoroughly updated to reflect recent advances in the field. The emphasis continues to be on exploratory data analysis rather than statistical theory. The coverage offers in-depth treatment of regression diagnostics, transformation, multicollinearity, logistic regression, and robust regression. Methods of regression analysis are clearly demonstrated, and examples containing the types of irregularities commonly encountered in the real world are provided. Each example isolates one or two techniques and features detailed discussions of the techniques themselves, the required assumptions, and the evaluated success of each technique-- Provided by publisher.
Table of contents provided by Syndetics
- Preface (p. xiv)
- 1 Introduction (p. 1)
- 1.1 What Is Regression Analysis? (p. 1)
- 1.2 Publicly Available Data Sets (p. 2)
- 1.3 Selected Applications of Regression Analysis (p. 3)
- 1.4 Steps in Regression Analysis (p. 13)
- 1.5 Scope and Organization of the Book (p. 21)
- Exercises (p. 23)
- 2 Simple Linear Regression (p. 25)
- 2.1 Introduction (p. 25)
- 2.2 Covariance and Correlation Coefficient (p. 25)
- 2.3 Example: Computer Repair Data (p. 30)
- 2.4 The Simple Linear Regression Model (p. 32)
- 2.5 Parameter Estimation (p. 33)
- 2.6 Tests of Hypotheses (p. 36)
- 2.7 Confidence Intervals (p. 41)
- 2.8 Predictions (p. 41)
- 2.9 Measuring the Quality of Fit (p. 43)
- 2.10 Regression Line Through the Origin (p. 46)
- 2.11 Trivial Regression Models (p. 48)
- 2.12 Bibliographic Notes (p. 49)
- Exercises (p. 49)
- 3 Multiple Linear Regression (p. 57)
- 3.1 Introduction (p. 57)
- 3.2 Description of the Data and Model (p. 57)
- 3.3 Example: Supervisor Performance Data (p. 58)
- 3.4 Parameter Estimation (p. 61)
- 3.5 Interpretations of Regression Coefficients (p. 62)
- 3.6 Centering and Scaling (p. 64)
- 3.7 Properties of the Least Squares Estimators (p. 67)
- 3.8 Multiple Correlation Coefficient (p. 68)
- 3.9 Inference for Individual Regression Coefficients (p. 69)
- 3.10 Tests of Hypotheses in a Linear Model (p. 71)
- 3.11 Predictions (p. 81)
- 3.12 Summary (p. 82)
- Exercises (p. 82)
- Appendix: Multiple Regression in Matrix Notation (p. 89)
- 4 Regression Diagnostics: Detection of Model Violations (p. 93)
- 4.1 Introduction (p. 93)
- 4.2 The Standard Regression Assumptions (p. 94)
- 4.3 Various Types of Residuals (p. 96)
- 4.4 Graphical Methods (p. 98)
- 4.5 Graphs Before Fitting a Model (p. 101)
- 4.6 Graphs After Fitting a Model (p. 105)
- 4.7 Checking Linearity and Normality Assumptions (p. 105)
- 4.8 Leverage, Influence, and Outliers (p. 106)
- 4.9 Measures of Influence (p. 111)
- 4.10 The Potential-Residual Plot (p. 115)
- 4.11 What to Do with the Outliers? (p. 116)
- 4.12 Role of Variables in a Regression Equation (p. 117)
- 4.13 Effects of an Additional Predictor (p. 122)
- 4.14 Robust Regression (p. 123)
- Exercises (p. 123)
- 5 Qualitative Variables as Predictors (p. 129)
- 5.1 Introduction (p. 129)
- 5.2 Salary Survey Data (p. 130)
- 5.3 Interaction Variables (p. 133)
- 5.4 Systems of Regression Equations (p. 136)
- 5.5 Other Applications of Indicator Variables (p. 147)
- 5.6 Seasonality (p. 148)
- 5.7 Stability of Regression Parameters Over Time (p. 149)
- Exercises (p. 151)
- 6 Transformation of Variables (p. 163)
- 6.1 Introduction (p. 163)
- 6.2 Transformations to Achieve Linearity (p. 165)
- 6.3 Bacteria Deaths Due to XRay Radiation (p. 167)
- 6.4 Transformations to Stabilize Variance (p. 171)
- 6.5 Detection of Heteroscedastic Errors (p. 176)
- 6.6 Removal of Heteroscedasticity (p. 178)
- 6.7 Weighted Least Squares (p. 179)
- 6.8 Logarithmic Transformation of Data (p. 180)
- 6.9 Power Transformation (p. 181)
- 6.10 Summary (p. 185)
- Exercises (p. 186)
- 7 Weighted Least Squares (p. 191)
- 7.1 Introduction (p. 191)
- 7.2 Heteroscedastic Models (p. 192)
- 7.3 Two-Stage Estimation (p. 195)
- 7.4 Education Expenditure Data (p. 197)
- 7.5 Fitting a Dose-Response Relationship Curve (p. 206)
- Exercises (p. 208)
- 8 The Problem of Correlated Errors (p. 209)
- 8.1 Introduction: Autocorrelation (p. 209)
- 8.2 Consumer Expenditure and Money Stock (p. 210)
- 8.3 Durbin-Watson Statistic (p. 212)
- 8.4 Removal of Autocorrelation by Transformation (p. 214)
- 8.5 Iterative Estimation With Autocorrelated Errors (p. 216)
- 8.6 Autocorrelation and Missing Variables (p. 217)
- 8.7 Analysis of Housing Starts (p. 218)
- 8.8 Limitations of Durbin-Watson Statistic (p. 222)
- 8.9 Indicator Variables to Remove Seasonality (p. 223)
- 8.10 Regressing Two Time Series (p. 226)
- Exercises (p. 228)
- 9 Analysis of Collinear Data (p. 233)
- 9.1 Introduction (p. 233)
- 9.2 Effects of Collinearity on Inference (p. 234)
- 9.3 Effects of Collinearity on Forecasting (p. 240)
- 9.4 Detection of Collinearity (p. 245)
- Exercises (p. 254)
- 10 Working With Collinear Data (p. 259)
- 10.1 Introduction (p. 259)
- 10.2 Principal Components (p. 259)
- 10.3 Computations Using Principal Components (p. 263)
- 10.4 Imposing Constraints (p. 263)
- 10.5 Searching for Linear Functions of the βâÇÖs (p. 267)
- 10.6 Biased Estimation of Regression Coefficients (p. 272)
- 10.7 Principal Components Regression (p. 272)
- 10.8 Reduction of Collinearity in the Estimation Data (p. 274)
- 10.9 Constraints on the Regression Coefficients (p. 276)
- 10.10 Principal Components Regression: A Caution (p. 277)
- 10.11 Ridge Regression (p. 280)
- 10.12 Estimation by the Ridge Method (p. 281)
- 10.13 Ridge Regression: Some Remarks (p. 285)
- 10.14 Summary (p. 287)
- 10.15 Bibliographic Notes (p. 288)
- Exercises (p. 288)
- Appendix 10.A Principal Components (p. 291)
- Appendix 10.B Ridge Regression (p. 294)
- Appendix 10.C Surrogate Ridge Regression (p. 297)
- 11 Variable Selection Procedures (p. 299)
- 11.1 Introduction (p. 299)
- 11.2 Formulation of the Problem (p. 300)
- 11.3 Consequences of Variables Deletion (p. 300)
- 11.4 Uses of Regression Equations (p. 302)
- 11.5 Criteria for Evaluating Equations (p. 303)
- 11.6 Collinearity and Variable Selection (p. 306)
- 11.7 Evaluating All Possible Equations (p. 306)
- 11.8 Variable Selection Procedures (p. 307)
- 11.9 General Remarks on Variable Selection Methods (p. 309)
- 11.10 A Study of Supervisor Performance (p. 310)
- 11.11 Variable Selection With Collinear Data (p. 314)
- 11.12 The Homicide Data (p. 314)
- 11.13 Variable Selection Using Ridge Regression (p. 317)
- 11.14 Selection of Variables in an Air Pollution Study (p. 318)
- 11.15 A Possible Strategy for Fitting Regression Models (p. 326)
- 11.16 Bibliographic Notes (p. 327)
- Exercises (p. 328)
- Appendix: Effects of Incorrect Model Specifications (p. 332)
- 12 Logistic Regression (p. 335)
- 12.1 Introduction (p. 335)
- 12.2 Modeling Qualitative Data (p. 336)
- 12.3 The Logit Model (p. 336)
- 12.4 Example: Estimating Probability of Bankruptcies (p. 338)
- 12.5 Logistic Regression Diagnostics (p. 341)
- 12.6 Determination of Variables to Retain (p. 342)
- 12.7 Judging the Fit of a Logistic Regression (p. 345)
- 12.8 The Multinomial Logit Model (p. 347)
- 12.8.1 Multinomial Logistic Regression (p. 347)
- 12.9 Classification Problem: Another Approach (p. 354)
- Exercises (p. 355)
- 13 Further Topics (p. 359)
- 13.1 Introduction (p. 359)
- 13.2 Generalized Linear Model (p. 359)
- 13.3 Poisson Regression Model (p. 360)
- 13.4 Introduction of New Drugs (p. 361)
- 13.5 Robust Regression (p. 363)
- 13.6 Fitting a Quadratic Model (p. 364)
- 13.7 Distribution of PCB in U.S. Bays (p. 366)
- Exercises (p. 370)
- Appendix A Statistical Tables (p. 371)
- References (p. 381)
- Index (p. 389)
Author notes provided by Syndetics
SAMPRIT CHATTERJEE, PhD, is Professor Emeritus of Statistics at New York University. A Fellow of the American Statistical Association, Dr. Chatterjee has been a Fulbright scholar in both Kazhakstan and Mongolia. He is the coauthor of Sensitivity Analysis in Linear Regression and A Casebook for a First Course in Statistics and Data Analysis, both published by Wiley.
ALI S. HADI, PhD, is a Distinguished University Professor and former vice provost at the American University in Cairo (AUC). He is the founding Director of the Actuarial Science Program at AUC. He is also a Stephen H. Weiss Presidential Fellow and Professor Emeritus at Cornell University. Dr. Hadi is the author of four other books, a Fellow of the American Statistical Association, and an elected Member of the International Statistical Institute.