Sources of Secondary Data in India

In the previous chapter, "Questionnaires and Schedules," we looked at the heavy lifting required to gather primary data. We saw how an investigator has to carefully design questions, hire field workers, and spend considerable time and money to extract fresh information directly from the source.

But what if you don't have the time, the budget, or the manpower to survey thousands of people? What if the data you need—say, the literacy rate of every district in India, or the total amount of bank deposits in the country over the last ten years—is so massive that no single independent researcher could possibly collect it?

This is where secondary data comes to the rescue. Secondary data is simply data that someone else has already collected, processed, and stored. Your job as a statistician or researcher shifts from being a data collector to a data consumer.

In India, the ecosystem of secondary data is vast, rich, and heavily driven by government machinery. To use secondary data effectively, you must know exactly where to look. Broadly, sources of secondary data are divided into two categories: Published Sources and Unpublished Sources.

Let us explore this landscape in detail, starting with the most visible and widely used category.

1. Published Sources of Secondary Data

When an organization collects data and makes it available to the public—whether in print, as downloadable reports, or through online databases—it becomes a published source.

Because India is a massive, complex economy, the government is the biggest collector and publisher of data. No private company has the resources to knock on every single door in the country. Therefore, official government publications form the absolute backbone of secondary data in India.

Let us look at the heavyweights you need to know.

The Giant of Indian Statistics: The Census of India

If there is one statistical exercise that defines India's data landscape, it is the Census. Conducted once every ten years (decennially), the Census of India is the largest single source of statistical information on the people of India.

Many people think the Census is just a simple headcount to find out the total population. It is actually much more than that. The Census collects incredibly detailed data on:

• Demographics: Age, sex, marital status.
• Economic Activity: How many people are working, what kind of work they do (agriculture, manufacturing, services), and how many are seeking work.
• Social Statistics: Literacy rates, educational attainment, languages spoken, and religion.
• Migration: How many people have moved from rural to urban areas, or from one state to another, and why.
• Housing and Amenities: What materials houses are made of, access to drinking water, electricity, and sanitation facilities.

Who publishes it? This is a crucial detail. The Census is conducted and published by the Office of the Registrar General and Census Commissioner, India.

Why use it? The Census is an example of complete enumeration. It does not rely on a sample; it aims to count every single individual in the country. If a researcher wants to study the exact male-to-female ratio in a specific remote tehsil of Jammu & Kashmir, the Census is the only reliable secondary source that drills down to the village and ward level.

The Pulse of the Economy: National Sample Survey Office (NSSO)

While the Census counts everyone once a decade, the government cannot wait ten years to know what is happening in the economy. To fill this gap, we have the National Sample Survey Office (NSSO).

Instead of complete enumeration, the NSSO relies on sample surveys. They select a scientifically representative sample of households across the country and interview them. Because they are only surveying a sample, they can do this continuously, year after year.

The NSSO conducts surveys in what they call "Rounds." Each round focuses on a specific theme. For example, one round might focus entirely on employment, while the next round focuses on health and education.

Key data published by the NSSO includes:

• Consumer Expenditure: How much money Indian households are spending on food, clothing, rent, and education. This data is vital for calculating poverty lines.
• Employment and Unemployment: The most authoritative data on how many people are employed, underemployed, or jobless.
• Housing Conditions and Slums: Detailed reports on urban and rural living conditions.
• Health and Morbidity: Data on the prevalence of diseases, out-of-pocket medical expenses, and maternal care.

The Financial Watchdog: Reserve Bank of India (RBI)

If your statistical inquiry involves money, banking, inflation, or foreign exchange, your primary destination for secondary data is the Reserve Bank of India. As the central bank, the RBI has unparalleled access to the financial data of every bank and financial institution in the country.

The RBI publishes several highly respected reports:

• The RBI Bulletin: A monthly publication that provides a comprehensive snapshot of the economy. It includes data on money supply, credit growth, inflation rates, and government finances.
• Handbook of Statistics on the Indian Economy: An annual goldmine for researchers. It provides historical time-series data (often going back decades) on national income, output, prices, money, banking, and financial markets.
• Report on Trend and Progress of Banking in India: An annual statutory report that details the health of the banking sector, including data on Non-Performing Assets (NPAs) and bank profitability.

Other Major Government Publications

Beyond the big three, various government ministries publish specialized data related to their specific domains.

1. 1Ministry of Agriculture: The Directorate of Economics and Statistics under this ministry publishes vital data on crop acreage (how much land is planted with wheat, rice, etc.), crop yield, and agricultural prices. If you are studying the impact of monsoon failure on apple production, this is your source.
2. 2Labour Bureau: Operating under the Ministry of Labour and Employment, the Labour Bureau publishes data on industrial disputes, absenteeism, and most importantly, the Consumer Price Index for Industrial Workers (CPI-IW). This specific index is used to calculate the Dearness Allowance (DA) for government employees.
3. 3Ministry of Commerce and Industry: Publishes data on wholesale prices (the Wholesale Price Index or WPI), foreign trade (exports and imports), and industrial production.

2. Semi-Government Publications

Moving one step down from the central and state ministries, we find semi-government bodies. These are local authorities like Municipal Corporations, District Boards, Zila Parishads, and Panchayats.

These bodies are legally required to maintain certain civic records. They regularly publish data regarding:

• Vital Statistics: Records of births, deaths, and marriages within their jurisdiction.
• Health and Sanitation: Data on the outbreak of diseases (like dengue or cholera cases in a city), vaccination drives, and waste management metrics.
• Education: Enrollment numbers in municipal schools.

Example: If a researcher wants to study the infant mortality rate specifically within the city limits of Srinagar over the last five years, the annual health reports published by the Srinagar Municipal Corporation would be a highly accurate semi-government secondary source.

3. Private and Commercial Publications

Not all valuable data comes from the government. Private entities, industry watchdogs, and commercial research firms generate massive amounts of secondary data, often filling the gaps left by official statistics.

Trade and Professional Associations

Organizations that represent specific industries collect data from their member companies to track industry growth and lobby the government.

• FICCI (Federation of Indian Chambers of Commerce & Industry) and CII (Confederation of Indian Industry) publish detailed reports on industrial climate, manufacturing trends, and business confidence.
• SIAM (Society of Indian Automobile Manufacturers) is the go-to source for data on how many cars, trucks, and two-wheelers were manufactured and sold in India in a given month.

Research Institutes

Independent research bodies conduct their own studies and publish the data for public or commercial use.

• CMIE (Centre for Monitoring Indian Economy): This is a highly prominent private think-tank in India. Because government employment data (like the NSSO) can sometimes take years to be published, CMIE conducts its own high-frequency surveys and publishes monthly unemployment rates. Financial journalists and economists rely heavily on CMIE data.
• Indian Statistical Institute (ISI): Publishes advanced academic research and statistical models.
• NCAER (National Council of Applied Economic Research): Publishes data on household income, consumer demographics, and economic forecasting.

Financial Dailies and Journals

Newspapers like The Economic Times, Business Standard, and Mint, as well as journals like the Economic and Political Weekly (EPW), compile and publish data on stock markets, commodity prices, and corporate earnings. While they often republish government data, they also compile their own indices and corporate data sets.

4. International Publications

In an interconnected world, researchers often need to compare India's performance against other countries. International organizations compile data supplied by individual national governments and standardize it so that global comparisons can be made.

Major international sources include:

• The United Nations (UN): Publishes the Statistical Yearbook and the Human Development Report (which contains the Human Development Index, tracking life expectancy, education, and per capita income).
• The World Bank: Publishes the World Development Indicators, a massive database covering everything from global poverty rates to carbon emissions.
• The International Monetary Fund (IMF): Publishes the World Economic Outlook, providing data on global GDP growth, inflation, and international trade balances.
• World Health Organization (WHO): The primary source for global health statistics, disease outbreaks, and healthcare infrastructure data.

5. The Hidden Goldmine: Unpublished Sources of Secondary Data

So far, everything we have discussed is published—meaning it was intentionally formatted, printed, or uploaded for public consumption. However, a vast ocean of data exists that has been collected and recorded but never officially published.

Why would data remain unpublished? Usually, it is because the data is meant strictly for internal administrative use, it is confidential, or the collector simply lacked the funds or motivation to publish it.

If a researcher can gain access to these unpublished sources, they can uncover highly unique insights that no one else has analyzed.

Examples of Unpublished Sources:

1. 1Internal Company Records:

Imagine a large retail chain like Reliance Smart. Every day, their billing software records exactly what items are bought, at what time, and in what quantities. This data is collected for their own inventory management. They do not publish this data in a magazine. However, if a researcher gets permission to access this internal ledger to study "consumer buying patterns during winter," they are using an unpublished secondary source.

1. 1University Research and Theses:

Every year, thousands of PhD scholars and university professors conduct primary research. They collect raw data, analyze it, and write a thesis. While the final thesis might sit in a university library, the raw data tables they compiled are rarely published in mainstream journals. Another researcher could request this raw data for a different analysis.

1. 1Administrative Records of Government Offices:

Not all government data makes it into a glossy report. The daily attendance register of a government school, the daily FIR log at a local police station, or the internal memos of a block development office are all rich sources of unpublished secondary data.

1. 1Personal Diaries and Letters:

In historical and qualitative statistical research, the personal diaries, account books, and letters of individuals (like a 19th-century merchant's daily ledger of spice prices) serve as vital unpublished secondary data.

The Challenge of Unpublished Data

While unpublished data can be incredibly specific and valuable, it is often messy. Because it was never intended for public consumption, it might lack proper labels, clear definitions, or standardized formatting. The researcher has to work much harder to clean and interpret this data compared to a neatly formatted RBI Bulletin.

Worked Example: Choosing the Right Source

To solidify your understanding, let us look at a practical scenario of how a researcher selects secondary data sources.

The Scenario: Dr. Sharma is an economist researching the impact of the COVID-19 pandemic on the livelihoods of factory workers in Maharashtra between 2020 and 2022. She does not have the budget to survey workers herself.

Step-by-Step Source Selection:

1. 1Macro-level Employment Data:

Dr. Sharma first needs to know the overall unemployment rate in Maharashtra during those years. Source chosen: The Periodic Labour Force Survey (PLFS) published by the NSO (MoSPI). She also checks CMIE data for month-by-month high-frequency unemployment figures.

1. 1Inflation and Cost of Living:

To understand how inflation affected these workers, she needs to know the cost of living for industrial workers. Source chosen: The Consumer Price Index for Industrial Workers (CPI-IW), published by the Labour Bureau.

1. 1Factory Closures and Industrial Output:

She needs data on how many factories shut down or reduced production. Source chosen: The Index of Industrial Production (IIP) published by the Ministry of Commerce, and reports from the Confederation of Indian Industry (CII).

1. 1Micro-level/Unpublished Data:

To get a localized view, she visits the municipal office of a major industrial zone in Pune and requests access to their internal, unpublished registry of cancelled trade licenses during 2021.

By combining these various published and unpublished secondary sources, Dr. Sharma can build a comprehensive statistical study without ever conducting a primary survey.

Quick Revision

• Secondary Data is data collected by someone else for their own purpose, which you are now using for your study.
• Published Sources are officially released to the public (reports, journals, websites).
• Unpublished Sources are internal records, raw research data, or administrative logs not meant for public release.
• Census of India: Conducted every 10 years by the Registrar General and Census Commissioner (Ministry of Home Affairs). Provides complete enumeration of demographics.
• NSSO (now NSO): Under MoSPI. Conducts continuous sample surveys on employment, consumer expenditure, and housing.
• RBI: The central bank; publishes the RBI Bulletin and Handbook of Statistics on the Indian Economy (money, banking, forex).
• Labour Bureau: Publishes the CPI-IW (Consumer Price Index for Industrial Workers).
• Semi-Government Sources: Municipalities and Panchayats (births, deaths, local health data).
• Private Sources: CMIE (unemployment data), FICCI, CII, and financial newspapers.
• International Sources: UN, World Bank, IMF, WHO (used for global comparisons).