Outline of regression analysis
From Infogalactic: the planetary knowledge core
The following outline is provided as an overview of and topical guide to regression analysis, which involves any of several statistical techniques for learning about the relationship between one or more dependent variables (Y) and one or more independent variables (X).
Contents
- 1 Overview articles
- 2 Non-statistical articles related to regression
- 3 Basic statistical ideas related to regression
- 4 Visualization
- 5 Linear regression based on least squares
- 6 Generalized linear models
- 7 Computation
- 8 Inference for regression models
- 9 Challenges to regression modeling
- 10 Diagnostics for regression models
- 11 Formal aids to model selection
- 12 Robust regression
- 13 Terminology
- 14 Methods for dependent data
- 15 Nonparametric regression
- 16 Semiparametric regression
- 17 Other forms of regression
- 18 See also
Overview articles
- Least squares
- Linear least squares (mathematics)
- Non-linear least squares
- Least absolute deviations
- Curve fitting
- Smoothing
- Cross-sectional study
- Conditional expectation
- Correlation
- Correlation coefficient
- Mean square error
- Residual sum of squares
- Explained sum of squares
- Total sum of squares
Visualization
Linear regression based on least squares
- General linear model
- Ordinary least squares
- Generalized least squares
- Simple linear regression
- Trend estimation
- Ridge regression
- Polynomial regression
- Segmented regression
- Nonlinear regression
Generalized linear models
- Generalized linear models
- Logistic regression
- Ordered logit
- Probit model
- Ordered probit
- Poisson regression
- Maximum likelihood
- Cochrane–Orcutt estimation
Computation
Inference for regression models
- F-test
- t-test
- Lack-of-fit sum of squares
- Confidence band
- Coefficient of determination
- Multiple correlation
- Scheffé's method
Challenges to regression modeling
- Autocorrelation
- Cointegration
- Multicollinearity
- Homoscedasticity and heteroscedasticity
- Lack of fit
- Non-normality of errors
- Outliers
Diagnostics for regression models
- Regression model validation
- Studentized residual
- Cook's distance
- Variance inflation factor
- DFFITS
- Partial residual plot
- Partial regression plot
- Leverage
- Durbin–Watson statistic
- Condition number
Formal aids to model selection
- Model selection
- Mallows's Cp
- Akaike information criterion
- Bayesian information criterion
- Hannan–Quinn information criterion
- Cross validation
Robust regression
Terminology
- Linear model — relates to meaning of "linear"
- Dependent and independent variables
- Errors and residuals in statistics
- Hat matrix
- Trend stationary
- Cross-sectional data
- Time series
Methods for dependent data
Nonparametric regression
Semiparametric regression
Other forms of regression
- Total least squares regression
- Deming regression
- Errors-in-variables model
- Instrumental variables regression
- Quantile regression
- Generalized additive model
- Autoregressive model
- Moving average model
- Autoregressive moving average model
- Autoregressive integrated moving average
- Autoregressive conditional heteroskedasticity