|
 
 |
| CURRICULUM IN CARDIOLOGY - STATISTICS |
|
| Year : 2018 | Volume
: 4
| Issue : 1 | Page : 33-36 |
|
Linear regression analysis study
Khushbu Kumari, Suniti Yadav
Department of Anthropology, University of Delhi, New Delhi, India
| Date of Web Publication | 4-May-2018 |
Correspondence Address:
Khushbu Kumari
Department of Anthropology, University of Delhi, New Delhi
India
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/jpcs.jpcs_8_18
Linear regression is a statistical procedure for calculating the value of a dependent variable from an independent variable. Linear regression measures the association between two variables. It is a modeling technique where a dependent variable is predicted based on one or more independent variables. Linear regression analysis is the most widely used of all statistical techniques. This article explains the basic concepts and explains how we can do linear regression calculations in SPSS and excel. Keywords: Continuous variable test, excel and SPSS analysis, linear regression
How to cite this article:
Kumari K, Yadav S. Linear regression analysis study. J Pract Cardiovasc Sci 2018;4:33-6 |
| Introduction | |  |
The concept of linear regression was first proposed by Sir Francis Galton in 1894. Linear regression is a statistical test applied to a data set to define and quantify the relation between the considered variables. Univariate statistical tests such as Chi-square, Fisher's exact test, t-test, and analysis of variance (ANOVA) do not allow taking into account the effect of other covariates/confounders during analyses (Chang 2004). However, partial correlation and regression are the tests that allow the researcher to control the effect of confounders in the understanding of the relation between two variables (Chang 2003).
In biomedical or clinical research, the researcher often tries to understand or relate two or more independent (predictor) variables to predict an outcome or dependent variable. This may be understood as how the risk factors or the predictor variables or independent variables account for the prediction of the chance of a disease occurrence, i.e., dependent variable. Risk factors (or dependent variables) associate with biological (such as age and gender), physical (such as body mass index and blood pressure [BP]), or lifestyle (such as smoking and alcohol consumption) variables with the disease. Both correlation and regression provide this opportunity to understand the “risk factors-disease” relationship (Gaddis and Gaddis 1990). While correlation provides a quantitative way of measuring the degree or strength of a relation between two variables, regression analysis mathematically describes this relationship. Regression analysis allows predicting the value of a dependent variable based on the value of at least one independent variable.
In correlation analysis, the correlation coefficient “r” is a dimensionless number whose value ranges from −1 to +1. A value toward −1 indicates inverse or negative relationship, whereas towards +1 indicate a positive relation. When there is a normal distribution, the Pearson's correlation is used, whereas, in nonnormally distributed data, Spearman's rank correlation is used.
The linear regression analysis uses the mathematical equation, i.e., y = mx + c, that describes the line of best fit for the relationship between y (dependent variable) and x (independent variable). The regression coefficient, i.e., r2 implies the degree of variability of y due to x.[1],[2],[3],[4],[5],[6],[7],[8]
| Significance of Linear Regression | | |
The use of linear regression model is important for the following reasons:
- Descriptive – It helps in analyzing the strength of the association between the outcome (dependent variable) and predictor variables
- Adjustment – It adjusts for the effect of covariates or the confounders
- Predictors – It helps in estimating the important risk factors that affect the dependent variable
- Extent of prediction – It helps in analyzing the extent of change in the independent variable by one “unit” would affect the dependent variable
- Prediction – It helps in quantifying the new cases.
| Assumptions for Linear Regression | | |
The underlying assumptions for linear regression are:
- The values of independent variable “x” are set by the researcher
- The independent variable “x” should be measured without any experimental error
- For each value of “x,” there is a subpopulation of “y” variables that are normally distributed up and down the Y-axis [Figure 1]
- The variances of the subpopulations of “y” are homogeneous
- The mean values of the subpopulations of “y” lie on a straight line, thus implying the assumption that there exists a linear relation between the dependent and the independent variables
- All the values of “y” are independent from each other, though dependent on “x.”
| Coefficient of Determination, R2 | | |
The coefficient of determination is the portion of the total variation in the dependent variable that can be explained by variation in the independent variable(s). When R2 is + 1, there exists a perfect linear relationship between x and y, i.e., 100% of the variation in y is explained by variation in x. When it is 0< R2<1, there is a weaker linear relationship between x and y, i.e., some, but not all of the variation in y is explained by variation in x.
| Linear Regression in Biological Data Analysis | | |
In biological or medical data, linear regression is often used to describe relationships between two variables or among several variables through statistical estimation. For example, to know whether the likelihood of having high systolic BP (SBP) is influenced by factors such as age and weight, linear regression would be used. The variable to be explained, i.e., SBP is called the dependent variable, or alternatively, the response variables that explain it age, weight, and sex are called independent variables.
| How to Calculate Linear Regression? | | |
Linear regression can be tested through the SPSS statistical software (IBM Corp. Released 2011. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.) in five steps to analyze data using linear regression. Following is the procedure followed [Table 1], [Table 2], [Table 3], [Table 4]:
Click Analyze > Regression > Linear > then select Dependent and Independent variable > OK (enter).
Example 1 – Data (n = 55) on the age and the SBP were collected and linear regression model would be tested to predict BP with age. After checking the normality assumptions for both variables, bivariate correlation is tested (Pearson's correlation = 0.696, P < 0.001) and a graphical scatter plot is helpful in that case [Figure 2]. | Figure 2: Starting Data Analysis ToolPak. Click the OFFICE button and choose Excel options.
Click here to view |
Now to check the linear regression, put SBP as the dependent and age as the Independent variable.
This indicates the dependent and independent variables included in the test.
Pearson's correlation between SBP and age is given (r = 0.696). R2 = 0.485 which implies that only 48.5% of the SBP is explained by the age of a person.
The ANOVA table shows the “usefulness” of the linear regression model with P < 0.05.
This provides the quantification of the relationship between age and SBP. With every increase of 1 year in age, the SBP (on the average) increases by 1.051 (95% confidence interval 0.752–1.350) units, P < 0.001. The constant here has no “practical” meaning as it gives the value of the SBP when age = 0.
Further, if more than one independent variable is added, the linear regression model would adjust for the effect of other dependent variables when testing the effect of one variable.
Example 2 – If we want to see the genetic effect of variables, i.e., the effect of increase in per allele dose of any genetic variant (mutation) on the disease or phenotype, linear regression is used in a similar way as described above. The three genotypes, i.e., normal homozygote AA, heterozygote AB and homozygote mutant BB may be coded as 1, 2, and 3, respectively. The test may be preceded, and in a similar way, the unstandardized coefficient (β) would explain the effect on the dependent variable with per allele dose increase.
Example 3 – Using Excel to see the relationship between sale of medicine with the price of the medicine and TV advertisements.
[Table 5] contains data which can be entered into an Excel sheet. Follow instructions as shown in [Figure 2], [Figure 3], [Figure 4]. | Figure 3: The Tool Pak. Choose Add Ins > Choose Analysis ToolPak and select Go.
Click here to view |
 | Figure 4: The regression screen. Choose Data > Data Analysis > Regression. Input y Range: A1:A8. Input X Range: B1:C8. Check Labels, Residuals, Output Range as A50.
Click here to view |
As shown in [Table 6], Multiple R is the Correlation Coefficient, where 1 means a perfect correlation and zero means none. R Square is the coefficient of determination which here means that 92% of the variation can be explained by the variables. Adjusted R square adjusts for multiple variables and should be used here. here. [Table 7] shows how to create a linear regression equation from the data.
| Conclusion | | |
The techniques for testing the relationship between two variables are correlation and linear regression. Correlation quantifies the strength of the linear relationship between a pair of variables, whereas regression expresses the relationship in the form of an equation. In this article, we have used simple examples and SPSS and excel to illustrate linear regression analysis and encourage the readers to analyze their data by these techniques.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
| References | | |
| 1. | Schneider A, Hommel G, Blettner M. Linear regression analysis: Part 14 of a series on evaluation of scientific publications. Dtsch Arztebl Int 2010;107:776-82.  [ PUBMED] |
| 2. | Freedman DA. Statistical Models: Theory and Practice. Cambridge, USA: Cambridge University Press; 2009. |
| 3. | Chan YH. Biostatistics 201: Linear regression analysis. Age (years). Singapore Med J 2004;45:55-61. [ PUBMED] |
| 4. | Chan YH. Biostatistics 103: Qualitative data – Tests of independence. Singapore Med J 2003;44:498-503. [ PUBMED] |
| 5. | Gaddis ML, Gaddis GM. Introduction to biostatistics: Part 6, correlation and regression. Ann Emerg Med 1990;19:1462-8. [ PUBMED] |
| 6. | Mendenhall W, Sincich T. Statistics for Engineering and the Sciences. 3 rd ed. New York: Dellen Publishing Co.; 1992. |
| 7. | Panchenko D. 18.443 Statistics for Applications, Section 14, Simple Linear Regression. Massachusetts Institute of Technology: MIT OpenCourseWare; 2006. |
| 8. | Elazar JP. Multiple Regression in Behavioral Research: Explanation and Prediction. 2 nd ed. New York: Holt, Rinehart and Winston; 1982. |
[Figure 1], [Figure 2], [Figure 3], [Figure 4]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6], [Table 7]
| This article has been cited by | | 1 |
Prediction Mechanisms to Improve 5G Network User Allocation and Resource Management |
|
| Christos Bouras,Rafail Kalogeropoulos | | Wireless Personal Communications. 2021; | | [Pubmed] | [DOI] | | | 2 |
Multi-Objective Optimization of WEDM of Aluminum Hybrid Composites Using AHP and Genetic Algorithm |
|
| Amresh Kumar,Neelkanth Grover,Alakesh Manna,Raman Kumar,Jasgurpreet Singh Chohan,Sandeep Singh,Sunpreet Singh,Catalin Iulian Pruncu | | Arabian Journal for Science and Engineering. 2021; | | [Pubmed] | [DOI] | | | 3 |
Deceleration of the development of city gas connections amidst the covid-19 pandemic in the metropolitan area |
|
| A Prima,O Ridaliani,A Hamid,H Pramadika,H P Sanusi,A Rinanti | | IOP Conference Series: Earth and Environmental Science. 2021; 802(1): 012014 | | [Pubmed] | [DOI] | | | 4 |
Empirical analysis of regression techniques by house price and salary prediction |
|
| U Bansal,A Narang,A Sachdeva,I Kashyap,S P Panda | | IOP Conference Series: Materials Science and Engineering. 2021; 1022: 012110 | | [Pubmed] | [DOI] | | | 5 |
The role of predictive analytics to explain the employability of management graduates |
|
| Ramakrishnan Raman, Dhanya Pramod | | Benchmarking: An International Journal. 2021; ahead-of-p(ahead-of-p) | | [Pubmed] | [DOI] | | | 6 |
Deep and machine learning approaches for forecasting the residual value of heavy construction equipment: a management decision support model |
|
| Odey Alshboul, Ali Shehadeh, Maha Al-Kasasbeh, Rabia Emhamed Al Mamlook, Neda Halalsheh, Muna Alkasasbeh | | Engineering, Construction and Architectural Management. 2021; ahead-of-p(ahead-of-p) | | [Pubmed] | [DOI] | | | 7 |
Applying machine learning approach to predict students’ performance in higher educational institutions |
|
| Mohammed Nasiru Yakubu, A. Mohammed Abubakar | | Kybernetes. 2021; ahead-of-p(ahead-of-p) | | [Pubmed] | [DOI] | | | 8 |
Role of COVIDsafe app and control measures in Australia in combating COVID-19 pandemic |
|
| Hafiz Syed Mohsin Abbas, Xiaodong Xu, Chunxia Sun | | Transforming Government: People, Process and Policy. 2021; 15(4): 708 | | [Pubmed] | [DOI] | | | 9 |
Instructional leadership as a controlling function in secondary schools in Rangwe Sub County, Kenya: Influence on students’ learning outcomes |
|
| John James Juma, Zachary N Ndwiga, Milcah Nyaga | | Educational Management Administration & Leadership. 2021; : 1741143221 | | [Pubmed] | [DOI] | | | 10 |
The influence of culture on the development of youth entrepreneurs in a selected suburb in Cape Town |
|
| Nashwin Davids,Robertson Tengeh,Rodney Duffett | | EUREKA: Social and Humanities. 2021; (2): 24 | | [Pubmed] | [DOI] | | | 11 |
Nanotoxic Effects of Silver Nanoparticles on Normal HEK-293 Cells in Comparison to Cancerous HeLa Cell Line |
|
| Xiongwei Liu,Kuizhong Shan,Xiaxia Shao,Xianqing Shi,Yun He,Zhen Liu,Joe Antony Jacob,Lichun Deng | | International Journal of Nanomedicine. 2021; Volume 16: 753 | | [Pubmed] | [DOI] | | | 12 |
Modeling and parameter optimization of the papermaking processes by using regression tree model and full factorial design |
|
| JOSÉ L. RODRIGUEZ-ALVAREZ,,ROGELIO LOPEZ-HERRERA,IVÁN E. VILLALON-TURRUBIATES,GERARDO GRIJALVA-AVILA,JORGE L. GARCÍA ALCARAZ | | TAPPI Journal. 2021; 20(2): 123 | | [Pubmed] | [DOI] | | | 13 |
Prospects for the creation and use of paired and multiple correlation and regression models in beekeeping |
|
| O. Galatiuk,A. Lakhman,T. Romanishina,V. Behas | | Naukovij věsnik veterinarnoď medicini. 2021; (1(165)): 58 | | [Pubmed] | [DOI] | | | 14 |
Ensemble Machine Learning Assisted Reservoir Characterization Using Field Production Data–An Offshore Field Case Study |
|
| Baozhong Wang,Jyotsna Sharma,Jianhua Chen,Patricia Persaud | | Energies. 2021; 14(4): 1052 | | [Pubmed] | [DOI] | | | 15 |
A New Nanomaterial Based Biosensor for MUC1 Biomarker Detection in Early Diagnosis, Tumor Progression and Treatment of Cancer |
|
| Fulden Ulucan-Karnak,Sinan Akgöl | | Nanomanufacturing. 2021; 1(1): 14 | | [Pubmed] | [DOI] | | | 16 |
Influence of Financial Variables on the Development of Rural Communes of Eastern Poland in 2009–2018 |
|
| Andrzej Pawlik,Pawel Dziekanski,Jaroslaw W. Przybytniowski | | Risks. 2021; 9(8): 145 | | [Pubmed] | [DOI] | | | 17 |
Optimizing the Tolerance for the Products with Multi-Dimensional Chains via Simulated Annealing |
|
| Chen-Kun Tsung | | Symmetry. 2021; 13(10): 1780 | | [Pubmed] | [DOI] | | | 18 |
A simple method for correction of the systematic error in calculating biological age by the multiple regression equation |
|
| Anatoly Pisaruk | | Ageing & Longevity. 2021; (1 2021): 26 | | [Pubmed] | [DOI] | | | 19 |
A simple method for correction of the systematic error in calculating biological age by the multiple regression equation |
|
| Anatoly Pisaruk | | Ageing & Longevity. 2021; (1 2021): 26 | | [Pubmed] | [DOI] | | | 20 |
Alternative mathematical method for calculating biological age |
|
| Anatoly Pisaruk | | Ageing & Longevity. 2021; (2): 1 | | [Pubmed] | [DOI] | | | 21 |
Country’s Entrepreneurial Environment Predictors for Starting a New Venture—Evidence for Romania |
|
| Carmen Paunescu,Elisabeta Molnar | | Sustainability. 2020; 12(18): 7794 | | [Pubmed] | [DOI] | | | 22 |
Intention to Screen for Cervical Cancer Among Child Bearing Age Women in Bahir Dar City, North-West Ethiopia: Using Theory of Planned Behavior |
|
| Wallelign Alemnew, Getu Debalkie, Telake Azale | | International Journal of Women's Health. 2020; Volume 12: 1215 | | [Pubmed] | [DOI] | | | 23 |
An Economic Analysis on Years of Schooling of the Children Related to Financial Support from Family and Govt. & Non-Govt. Institutions |
|
| Vartika Tanania, Shipra Shukla, Shambhavi Singh | | British Journal of Arts and Humanities. 2020; : 665 | | [Pubmed] | [DOI] | | | 24 |
Estimation of Moisture Content in XLPE Insulation in Medium Voltage Cable by Frequency Domain Spectroscopy |
|
| A. K. Das,N. Haque,A. K. Pradhan,S. Dalai,B. Chatterjee,A. Mukherjee | | IEEE Transactions on Dielectrics and Electrical Insulation. 2020; 27(6): 1811 | | [Pubmed] | [DOI] | |
|
 |
|
|
|
Search Pubmed for