Estimating The True State Of Global Poverty With Machine Learning

A collaboration from UoC Berkeley, Stanford University and Facebook offers a deeper and more granular picture of the actual state of poverty in and across nations, through the use of machine learning.

The research, entitled Micro-Estimates of Wealth for all Low-and Middle-Income Countries, is accompanied by a beta website that allows users to interactively explore the absolute and relative economic state of fine-grained areas and pockets of poverty in low and middle-income countries.

The framework incorporates data from satellite imagery, topographic maps, mobile phone networks and aggregated anonymized data from Facebook, and is verified against extensive face-to-face surveys, for purposes of reporting relative wealth disparity in a region, rather than absolute estimates of income.

A map of global poverty, weighted towards the most affected areas. Lower, enlargements of South Africa and Lesotho (b); a 12sqkm area around the Khayelitsa township near Cape Town. Source: https://arxiv.org/ftp/arxiv/papers/2104/2104.07761.pdf

The system has been adopted by the government of Nigeria as a basis for administering social protection programs, and runs in tandem with the existing framework from the World Bank, the National Social Safety nets Project (NASSP). In February the first recipients under the scheme were paid a cash transfer of 5000 Nigerian naira, a benefit payable up to six months, until a threshold of one million naira is reached.

The paper asserts that data poverty makes a notable contribution to incorrect distribution of aid in countries with minimal data-gathering resources or limited infrastructure, and that politically motivated misreporting (a problem not limited to low-income countries) is also a factor in this regard.

Registering The ‘Unreported Poor’

The researchers’ simulations on the data demonstrated that, under existing regulations for allocation of aid resources, distribution based on this system increases payment to those most in need and decreases payment for existing recipients in higher-income brackets. The paper also notes the difficulty that social protection program administrators faced in allocating aid resources at the outset of the COVID-19 crisis, due to the lack of comprehensive or detailed data. In Nigeria, for example, the most recent survey data covers households in a mere 13.8% of all Nigerian districts, compared to the 100% coverage that the new scheme affords.

Previous work in AI-assisted poverty estimation has concentrated largely on satellite-obtained data (see below), but the researchers assert that data from mobile connectivity obtains a more accurate and granular insight into wealth disparity across regions, and this information stream provides half of all the contributing data for the project.

From the standpoint of generalization in machine learning data, the researchers observe that models trained in one country can be a beneficial and accurate template for models covering adjacent countries. They also note that the new framework is able not only to distinguish between urban and rural locales, but is capable of providing disparity maps within urbanized areas, which exceeds the scope of many recent research initiatives in this sector.

Satellite Imagery In Poverty Analysis

The principal behind satellite-based poverty analysis is the presumption that poor people have little money to run electric lights in the hour of darkness, or may have no electric light facility at all. Where the absence of pinpoint lights can be correlated to the presence of people, as ascertained by other means (such as mobile connectivity data), an index of deprivation can be generated.

This technique was proposed in 2016 in an earlier Stanford paper from another research group. The method detailed in that paper  pioneered the use of evening-time satellite coverage provided by the United States Air Force Defense Meteorological Satellite Program (DMSP) via the National Oceanic and Atmospheric Administration…