OHS-LFS Consistent Series Weights 1994-2007
South Africa, 1994 - 2007
Get Microdata
Reference ID
zaf-datafirst-olcs-1994-2007-v0411
Producer(s)
Branson, Nicola
Collections
Metadata
Created on
Jun 12, 2013
Last modified
Apr 28, 2020
Page views
6160
Downloads
2161
Identification
Survey ID Number
zaf-datafirst-olcs-1994-2007-v0411
Title
OHS-LFS Consistent Series Weights 1994-2007
Country
| Name | Country code |
|---|---|
| South Africa | zaf |
Study type
Household Survey [hh]
Abstract
One focus of post apartheid research in South Africa is change. Questions include the progress of South Africa in the economic, social and political arena. National datasets such as the October Household Surveys (OHS) and Labour Force Surveys (LFS) provide a rich source of information on both economic and social variables in a cross sectional framework. These datasets are repeated annually or biannually and therefore have the potential to highlight
changes over time. Yet to treat the cross sectional national data as a time series requires that, when stacked side by side, the data produce realistic trends. Since these data were not designed to be used as a time series, there are changes in sample design, the interview process and shifts in the sampling frame which can cause unrealistic changes in aggregates over a short period of time. This raises concerns about the validity of using these datasets as a time
series to examine change.
The aggregate trends calculated from the OHS and LFS show the data to be both temporally and internally inconsistent. Examining the weights given in the datasets, in addition to the public documentation, it is clear that the Statistics South Africa (StatsSA) household and person weights are not simple design weights i.e. inverse inclusion probability weights. StatsSA poststratifies the person design weight to external population totals. Since the data are cross sectional the intention of the post-stratification adjustment is to produce best estimates of the population given the information available at the time and temporal consistency is not considered. This creates problems when the data is used as a time series.
A project was thus undertaken by Nicola Branson at the University of Cape Town, with a scholarship from DataFirst as part of DataFirst's Data Quality Project, funded by the Mellon Foundation. to design a new set of person and household weights for the OHS 1994-1999 and the LFS 2000-2007. These weights are generated using an entropy estimation technique. The new weights result in consistent demographic and geographic trends and greater consistency between person and household level analysis.
This dataset consists of the cross-entrophy weights and the research resources used to construct them, including the syntax files, as well as background documentation on the project, and other research output. These should be used with the OHS and LFS data available from the data portal
changes over time. Yet to treat the cross sectional national data as a time series requires that, when stacked side by side, the data produce realistic trends. Since these data were not designed to be used as a time series, there are changes in sample design, the interview process and shifts in the sampling frame which can cause unrealistic changes in aggregates over a short period of time. This raises concerns about the validity of using these datasets as a time
series to examine change.
The aggregate trends calculated from the OHS and LFS show the data to be both temporally and internally inconsistent. Examining the weights given in the datasets, in addition to the public documentation, it is clear that the Statistics South Africa (StatsSA) household and person weights are not simple design weights i.e. inverse inclusion probability weights. StatsSA poststratifies the person design weight to external population totals. Since the data are cross sectional the intention of the post-stratification adjustment is to produce best estimates of the population given the information available at the time and temporal consistency is not considered. This creates problems when the data is used as a time series.
A project was thus undertaken by Nicola Branson at the University of Cape Town, with a scholarship from DataFirst as part of DataFirst's Data Quality Project, funded by the Mellon Foundation. to design a new set of person and household weights for the OHS 1994-1999 and the LFS 2000-2007. These weights are generated using an entropy estimation technique. The new weights result in consistent demographic and geographic trends and greater consistency between person and household level analysis.
This dataset consists of the cross-entrophy weights and the research resources used to construct them, including the syntax files, as well as background documentation on the project, and other research output. These should be used with the OHS and LFS data available from the data portal
Kind of Data
Sample survey data
Unit of Analysis
Households and individuals
Version
Version Description
Version 0411: Edited, anonymised dataset for public distribution
Version 0410 was provided to DataFirst by Nicola Branson in 2010.
Version 0411 is this dataset, with cross-entropy weights for OHS 1996 included. These were not in the original set of weights created by Nicola Branson, but have been created subsequently by DataFirst.
Version 0410 was provided to DataFirst by Nicola Branson in 2010.
Version 0411 is this dataset, with cross-entropy weights for OHS 1996 included. These were not in the original set of weights created by Nicola Branson, but have been created subsequently by DataFirst.
Version Date
2010
Version Notes
Version 0410 was provided to DataFirst by Nicola Branson in 2010.
Version 0411 is this dataset, with cross-entropy weights for OHS 1996 included. These were not in the original set of weights created by Nicola Branson, but have been created subsequently by DataFirst.
Version 0411 is this dataset, with cross-entropy weights for OHS 1996 included. These were not in the original set of weights created by Nicola Branson, but have been created subsequently by DataFirst.
Coverage
Geographic Coverage
The OHS and LFS had national coverage
Producers and sponsors
Primary investigators
| Name | Affiliation |
|---|---|
| Branson, Nicola | University of Cape Town |
Funding Agency/Sponsor
| Name |
|---|
| Mellon Foundation |
Data Collection
Dates of Data Collection
| Start | End |
|---|---|
| 1994 | 2007 |
Time periods
| Start date |
|---|
| 2008 |
Data Collection Mode
Face-to-face [f2f]
Data Appraisal
Data Appraisal
The purpose of survey weights is to inflate the sample to represent the entire population. These weights therefore play an important role in creating consistent aggregates over time. Statistics South Africa's (StatsSA) household and person weights are not simple design weights i.e. inverse inclusion probability weights. The weights presented in the StatsSA National Household surveys are the design weight post-stratified to external population totals. Since the data are cross sectional the intention of the post-stratification adjustment is to produce best estimates of the population given the information available at the time and temporal consistency is not considered. These cross entropy weights have been provided to render the OHS and LFS series consistent over time.
The original cross entropy weights created by Nicola Branson did not include weights for OHS 1996. These have now been created by DataFirst, using a later version of the OHS 1996 data provided by Statistics South Africa.
The original cross entropy weights created by Nicola Branson did not include weights for OHS 1996. These have now been created by DataFirst, using a later version of the OHS 1996 data provided by Statistics South Africa.
Access policy
Contacts
| Name | URL | |
|---|---|---|
| DataFirst Helpdesk | support@data1st.org | Link |
Access conditions
Public use files, available to all
Citation requirements
Branson, N. OHS-LFS Consistent Series weights 1994-2007 [dataset]. Version 0411. Cape Town: DataFirst [producer and distributor], 2010. DOI: https://doi.org/10.25828/5jtw-jq16
Access authority
| Name | Affiliation | URL | |
|---|---|---|---|
| Manager, DataFirst | University of Cape Town | info@data1st.org | Link |
Metadata production
DDI Document ID
ddi-zaf-datafirst-olcs-1994-2007-v1.1
Producers
| Name | Affiliation | Role |
|---|---|---|
| DataFirst | University of Cape Town | Metadata producer |
Date of Metadata Production
2020-04-28
DDI Document version
Version 2