Category: Statistics

• October 13, 2020

  Socio-economic analysis with nighttime light series. Step 1: downloading shapefile of the study area

  Context: we analyze economic changes in Colombian municipalities between 1993 and 2020. We need to download ArcGis, a geographic information system (GIS) for working with maps and geographic information maintained by the Environmental Systems Research Institute (Esri). It is used for creating and using maps, compiling geographic data, analyzing mapped information, sharing and discovering geographic…

• October 13, 2020

  Socio-economic analysis with nighttime light series: downloading nighttime images

  Context: we analyze economic changes in Colombian municipalities between 1993 and 2020. In this post, we focus on how to download our “raw data”, i.e. the nighttime light data for Colombia. Step 1: Download nighttime light series from NOAA National Centers for Environmental Information (NCEI). Particularly Version 4 DMSP-OLS Nighttime Lights Time Series (DMSP) –…

• March 13, 2018

  Overfitting in Statistics

  Figure 1.  The green line represents an overfitted model and the black line represents a regularized model. While the green line best follows the training data, it is too dependent on that data and it is likely to have a higher error rate on new unseen data, compared to the black line. Figure 2.  Noisy…