{"id":28434,"date":"2023-06-20T18:17:37","date_gmt":"2023-06-20T21:17:37","guid":{"rendered":"https:\/\/mindthegraph.com\/blog\/psychedelic-medicine-copy\/"},"modified":"2023-07-03T18:36:10","modified_gmt":"2023-07-03T21:36:10","slug":"regression-analysis","status":"publish","type":"post","link":"https:\/\/mindthegraph.com\/blog\/regression-analysis\/","title":{"rendered":"Using Regression Analysis to Understand Complex Relationships"},"content":{"rendered":"\n<p>Regression analysis is an approach for identifying and analyzing the connection between one or more independent variables and a dependent variable. This method is extensively used in a variety of disciplines, including healthcare, social sciences, engineering, economics, and business. You can use regression analysis to investigate the fundamental relationships in data and develop predictive models that will assist you in making informed decisions.<\/p>\n\n\n\n<p>This article will provide you with a comprehensive overview of regression analysis, including how it works, an easy-to-grasp example, and it will explain how it differs from correlation analysis.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-regression-analysis\">What Is Regression Analysis?<\/h2>\n\n\n\n<p>Regression analysis is a statistical method for identifying and quantifying the connection between a dependent variable and one or more independent variables. In a nutshell, it helps you comprehend how changes in one or more independent variables are related to changes in the dependent variable.<\/p>\n\n\n\n<p>To obtain a thorough understanding of regression analysis, you must first comprehend the following terms:<\/p>\n\n\n\n<ul>\n<li><strong>Dependent Variable: <\/strong>This is the variable that you&#8217;re interested in analyzing or predicting. It&#8217;s the outcome variable that you&#8217;re trying to understand and explain.<\/li>\n\n\n\n<li><strong>Independent Variables: <\/strong>These are the variables that you believe have an effect on the dependent variable. They&#8217;re often referred to as the predictor variables, as they&#8217;re used to predict or explain changes in the dependent variable.<\/li>\n<\/ul>\n\n\n\n<p>Regression analysis can be used for a range of circumstances, including predicting future values of the dependent variable, understanding the effect of independent variables on the dependent variable, and finding outliers or unusual occurrences in data collection.<\/p>\n\n\n\n<p>Regression analysis can be classified into several types, including single linear regression, logistic regression, polynomial regression, and multiple regression. The suitable regression model is determined by the nature of the data and the investigation&#8217;s subject under consideration.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-does-regression-analysis-work\">How Does Regression Analysis Work?<\/h2>\n\n\n\n<p>The purpose of regression analysis is to identify the best-fit line or curve that reflects the connection between the independent variables and the dependent variable. This best-fit line or curve is generated using statistical methods that reduce the disparities between the expected and real values in the data collection.<\/p>\n\n\n\n<p>Here are the formulas for the two most common types of regression analysis:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-single-linear-regression\">Single Linear Regression<\/h3>\n\n\n\n<p>In Simple Linear Regression, you use a line of best fit to show the relationship between two variables: the independent variable (x) and the dependent variable (y).<\/p>\n\n\n\n<p>The line of best fit can be represented by the equation: y = a + bx.<\/p>\n\n\n\n<p>Here, a is the intercept, b is the slope of the line. To calculate the slope, you use the formula: b = (n\u03a3(xy) &#8211; \u03a3x\u03a3y) \/ (n\u03a3(x<sup>2<\/sup>) &#8211; (\u03a3x)<sup>2<\/sup>), where n is the number of observations, \u03a3xy is the sum of the product of x and y, \u03a3x and \u03a3y are the sums of x and y respectively, and \u03a3(x<sup>2<\/sup>) is the sum of the squares of x.<\/p>\n\n\n\n<p>To calculate the intercept, you use the formula: a = (\u03a3y &#8211; b\u03a3x) \/ n.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-multiple-regression\">Multiple Regression&nbsp;<\/h3>\n\n\n\n<p>Multiple Linear Regression:<\/p>\n\n\n\n<p>The formula for the equation of the multiple linear regression model is:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p><strong>y = b<sub>0<\/sub> + b<sub>1<\/sub>x<sub>1<\/sub> + b<sub>2<\/sub>x<sub>2<\/sub> + &#8230; + b<sub>n<\/sub>x<sub>n<\/sub><\/strong><\/p>\n<\/blockquote>\n\n\n\n<p>where y is the dependent variable, x<sub>1<\/sub>, x<sub>2<\/sub>, &#8230;, x<sub>n<\/sub> are the independent variables, and b<sub>0<\/sub>, b<sub>1<\/sub>, b<sub>2<\/sub>, &#8230;, bn are the coefficients of the independent variables.<\/p>\n\n\n\n<p>The formula for estimating the coefficients using ordinary least squares is:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p><strong>\u03b2 = (X&#8217;X)<sup>(-1)<\/sup>X&#8217;y<\/strong><\/p>\n<\/blockquote>\n\n\n\n<p>where \u03b2 is a column vector of coefficients, X is the design matrix of independent variables, X&#8217; is the transpose of X, and y is the vector of observations of the dependent variable.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-regression-analysis-example\">Regression Analysis Example<\/h2>\n\n\n\n<p>Assume you want to look into the connection between an individual&#8217;s grade point average (GPA) and the number of hours they study per week. You gather information from a set of students, including their number of study hours and grade point average.<\/p>\n\n\n\n<p>Then, use the regression analysis to see if there is a linear connection between both variables and if so, you can build a model that predicts a student&#8217;s GPA based on the number of hours they study per week.<\/p>\n\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter is-resized\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/lh5.googleusercontent.com\/jY2vs2UsuRYMfVS7ZwPuk_epkVR-Yl7jnG8al1mDmUs6L8YsZ_X3WwNFy40jDCareFFtyOzL6b_DXIhO8FrJR1CMyVwg_rHyE1jycXX-LGWLsUf4LTzWV4L35ObUSidK1EsF136nqG-tHj_zjStgbbA\" alt=\"\" width=\"505\" height=\"263\"\/><figcaption class=\"wp-element-caption\"><em>Image available on <a href=\"https:\/\/www.alchemer.com\" target=\"_blank\" rel=\"noreferrer noopener\">alchemer.com<\/a><\/em><\/figcaption><\/figure><\/div>\n\n\n<p><a href=\"https:\/\/www.alchemer.com\/wp-content\/uploads\/2019\/04\/regression-analysis-1.png\"><\/a><\/p>\n\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>When the data is plotted on a scatter map, it appears that there is a favorable linear connection between study hours and GPA. The slope and intercept of the line of best fit are then estimated using a simple linear regression model. The final solution could look like this:<\/p>\n\n\n\n<p>GPA = 2.0 + 0.3 (hours studied per week)<\/p>\n\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter is-resized\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/lh6.googleusercontent.com\/plMkcFRz9dE-xiHm7wkzhCBplbaGIBdvzy4y8LmGqBEaFAMV72IUx7DRx8uvaU_TVMkcOlwcgH_s12NMZFjni4gWrlANjcBH2RqyoFKzrks9q3SGUDpnd_ILZZ4ookIPxD-PJ2T5L-HS3GaWCJf8yEE\" alt=\"\" width=\"505\" height=\"263\"\/><figcaption class=\"wp-element-caption\"><em><em>Image available on <a href=\"https:\/\/www.alchemer.com\" target=\"_blank\" rel=\"noreferrer noopener\">alchemer.com<\/a><\/em><\/em><\/figcaption><\/figure><\/div>\n\n\n<p><a href=\"https:\/\/www.alchemer.com\/wp-content\/uploads\/2019\/04\/regression-analysis-2.png\"><\/a><\/p>\n\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p>This equation states that for every extra hour of study per week, a student&#8217;s GPA will rise by 0.3 point, with everything else being equivalent. This algorithm can be used to forecast a student&#8217;s GPA based on how many hours they study per week, as well as to identify which students are at risk of underperforming based on their study routines.&nbsp;<\/p>\n\n\n\n<p>Using the data from the example, the values for <strong>b<\/strong> and <strong>a<\/strong> are as follows:<\/p>\n\n\n\n<p>n = 10 (the number of observations)<\/p>\n\n\n\n<p>\u03a3x = 30 (the sum of the study hours)<\/p>\n\n\n\n<p>\u03a3y = 25 (the sum of the GPAs)<\/p>\n\n\n\n<p>\u03a3xy = 149 (the sum of the product of study hours and GPAs)<\/p>\n\n\n\n<p>\u03a3(x)<sup>2<\/sup> = 102 (the sum of the squares of study hours)<\/p>\n\n\n\n<p>Using these values, calculate <strong>b<\/strong> as:<\/p>\n\n\n\n<p>b = (n\u03a3(xy) &#8211; \u03a3x\u03a3y) \/ (n\u03a3(x<sup>2<\/sup>) &#8211; (\u03a3x)<sup>2<\/sup>)<\/p>\n\n\n\n<p>= (10 * 149 &#8211; 30 * 25) \/ (10 * 102 &#8211; 30<sup>2<\/sup>)<\/p>\n\n\n\n<p>= 0.3<\/p>\n\n\n\n<p>And calculate <strong>a <\/strong>as:<\/p>\n\n\n\n<p>a = (\u03a3y &#8211; b\u03a3x) \/ n<\/p>\n\n\n\n<p>= (25 &#8211; 0.3 * 30) \/ 10<\/p>\n\n\n\n<p>= 2.0<\/p>\n\n\n\n<p>Therefore, the equation of the line of best fit is:&nbsp;<\/p>\n\n\n\n<p>GPA = 2.0 + 0.3 (hours studied per week)<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-the-difference-between-correlation-and-regression\">What is the difference between correlation and regression?<\/h2>\n\n\n\n<p>Both correlation and regression are statistical methods for examining the connection between two variables.&nbsp;They serve different purposes and provide differing types of information.<\/p>\n\n\n\n<p>Correlation is a measure of the strength and course of a connection between two variables. It runs from -1 to +1, with -1 representing a perfect negative correlation, 0 representing no correlation, and +1 representing a perfect positive correlation. Correlation indicates the degree to which two variables are connected, but it does not indicate cause or predictability.<\/p>\n\n\n\n<p>Regression, on the other hand, is a method for modeling the connection between two variables, typically in order to forecast or explain one variable based on the other. Regression analysis can provide estimations of the size and direction of the relationship, as well as statistical significance tests, confidence ranges, and future result forecasts.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-your-creations-ready-within-minutes\">Your Creations, ready within minutes<\/h2>\n\n\n\n<p><a href=\"https:\/\/mindthegraph.com\" target=\"_blank\" rel=\"noreferrer noopener\">Mind the Graph<\/a> is an online platform that offers you an extensive library of scientific illustrations and infographic designs that can be simply modified to meet your unique needs. Make professional-looking charts, posters, and graphical abstracts in minutes by using a drag-and-drop interface and a wide range of tools and features.&nbsp;<\/p>\n\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"800\" height=\"500\" src=\"https:\/\/mindthegraph.com\/blog\/wp-content\/uploads\/2023\/05\/banco.gif\" alt=\"\" class=\"wp-image-28087\"\/><\/figure><\/div>\n\n\n<div style=\"height:21px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"is-layout-flex wp-block-buttons\">\n<div class=\"wp-block-button aligncenter\"><a class=\"wp-block-button__link has-background wp-element-button\" href=\"https:\/\/mindthegraph.com\/\" style=\"border-radius:50px;background-color:#dc1866\" target=\"_blank\" rel=\"noreferrer noopener\">Start Creating With Mind the Graph<\/a><\/div>\n<\/div>\n\n\n\n<div style=\"height:44px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas. <\/p>\n","protected":false},"author":28,"featured_media":28437,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[959,28],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Using Regression Analysis to Understand Complex Relationships - Mind the Graph Blog<\/title>\n<meta name=\"description\" content=\"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mindthegraph.com\/blog\/\u0440\u0435\u0433\u0440\u0435\u0441\u0456\u0439\u043d\u0438\u0439-\u0430\u043d\u0430\u043b\u0456\u0437\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using Regression Analysis to Understand Complex Relationships\" \/>\n<meta property=\"og:description\" content=\"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mindthegraph.com\/blog\/\u0440\u0435\u0433\u0440\u0435\u0441\u0456\u0439\u043d\u0438\u0439-\u0430\u043d\u0430\u043b\u0456\u0437\/\" \/>\n<meta property=\"og:site_name\" content=\"Mind the Graph Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-20T21:17:37+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-03T21:36:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mindthegraph.com\/blog\/wp-content\/uploads\/2023\/07\/regression-analysis-blog.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1124\" \/>\n\t<meta property=\"og:image:height\" content=\"613\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jessica Abbadia\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Using Regression Analysis to Understand Complex Relationships\" \/>\n<meta name=\"twitter:description\" content=\"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/mindthegraph.com\/blog\/wp-content\/uploads\/2023\/07\/regression-analysis-blog.png\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jessica Abbadia\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Regression Analysis to Understand Complex Relationships - Mind the Graph Blog","description":"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mindthegraph.com\/blog\/\u0440\u0435\u0433\u0440\u0435\u0441\u0456\u0439\u043d\u0438\u0439-\u0430\u043d\u0430\u043b\u0456\u0437\/","og_locale":"en_US","og_type":"article","og_title":"Using Regression Analysis to Understand Complex Relationships","og_description":"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.","og_url":"https:\/\/mindthegraph.com\/blog\/\u0440\u0435\u0433\u0440\u0435\u0441\u0456\u0439\u043d\u0438\u0439-\u0430\u043d\u0430\u043b\u0456\u0437\/","og_site_name":"Mind the Graph Blog","article_published_time":"2023-06-20T21:17:37+00:00","article_modified_time":"2023-07-03T21:36:10+00:00","og_image":[{"width":1124,"height":613,"url":"https:\/\/mindthegraph.com\/blog\/wp-content\/uploads\/2023\/07\/regression-analysis-blog.png","type":"image\/png"}],"author":"Jessica Abbadia","twitter_card":"summary_large_image","twitter_title":"Using Regression Analysis to Understand Complex Relationships","twitter_description":"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.","twitter_image":"https:\/\/mindthegraph.com\/blog\/wp-content\/uploads\/2023\/07\/regression-analysis-blog.png","twitter_misc":{"Written by":"Jessica Abbadia","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mindthegraph.com\/blog\/uk\/%d1%80%d0%b5%d0%b3%d1%80%d0%b5%d1%81%d1%96%d0%b9%d0%bd%d0%b8%d0%b9-%d0%b0%d0%bd%d0%b0%d0%bb%d1%96%d0%b7\/","url":"https:\/\/mindthegraph.com\/blog\/uk\/%d1%80%d0%b5%d0%b3%d1%80%d0%b5%d1%81%d1%96%d0%b9%d0%bd%d0%b8%d0%b9-%d0%b0%d0%bd%d0%b0%d0%bb%d1%96%d0%b7\/","name":"Using Regression Analysis to Understand Complex Relationships - Mind the Graph Blog","isPartOf":{"@id":"https:\/\/mindthegraph.com\/blog\/#website"},"datePublished":"2023-06-20T21:17:37+00:00","dateModified":"2023-07-03T21:36:10+00:00","author":{"@id":"https:\/\/mindthegraph.com\/blog\/#\/schema\/person\/96ecc2d785106e951f7773dc7c96d699"},"description":"Understand how regression analysis works with ease using a comprehensive example and learn the most common formulas.","breadcrumb":{"@id":"https:\/\/mindthegraph.com\/blog\/uk\/%d1%80%d0%b5%d0%b3%d1%80%d0%b5%d1%81%d1%96%d0%b9%d0%bd%d0%b8%d0%b9-%d0%b0%d0%bd%d0%b0%d0%bb%d1%96%d0%b7\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mindthegraph.com\/blog\/uk\/%d1%80%d0%b5%d0%b3%d1%80%d0%b5%d1%81%d1%96%d0%b9%d0%bd%d0%b8%d0%b9-%d0%b0%d0%bd%d0%b0%d0%bb%d1%96%d0%b7\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mindthegraph.com\/blog\/uk\/%d1%80%d0%b5%d0%b3%d1%80%d0%b5%d1%81%d1%96%d0%b9%d0%bd%d0%b8%d0%b9-%d0%b0%d0%bd%d0%b0%d0%bb%d1%96%d0%b7\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mindthegraph.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Using Regression Analysis to Understand Complex Relationships"}]},{"@type":"WebSite","@id":"https:\/\/mindthegraph.com\/blog\/#website","url":"https:\/\/mindthegraph.com\/blog\/","name":"Mind the Graph Blog","description":"Your science can be beautiful!","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mindthegraph.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/mindthegraph.com\/blog\/#\/schema\/person\/96ecc2d785106e951f7773dc7c96d699","name":"Jessica Abbadia","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mindthegraph.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f477bd20199beb376b04b2fda9a2cec5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f477bd20199beb376b04b2fda9a2cec5?s=96&d=mm&r=g","caption":"Jessica Abbadia"},"description":"Jessica Abbadia is a lawyer that has been working in Digital Marketing since 2020, improving organic performance for apps and websites in various regions through ASO and SEO. Currently developing scientific and intellectual knowledge for the community's benefit. Jessica is an animal rights activist who enjoys reading and drinking strong coffee.","sameAs":["https:\/\/www.linkedin.com\/in\/jessica-abbadia-9b834a13b\/"],"url":"https:\/\/mindthegraph.com\/blog\/author\/jessica\/"}]}},"_links":{"self":[{"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/posts\/28434"}],"collection":[{"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/comments?post=28434"}],"version-history":[{"count":4,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/posts\/28434\/revisions"}],"predecessor-version":[{"id":28445,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/posts\/28434\/revisions\/28445"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/media\/28437"}],"wp:attachment":[{"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/media?parent=28434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/categories?post=28434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mindthegraph.com\/blog\/wp-json\/wp\/v2\/tags?post=28434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}