Questionnaires and Schedules

In the previous chapter, "Methods of Collecting Primary Data", we looked at the broad strategies an investigator can use to gather fresh, first-hand information. We learned that you can observe people, interview them directly, or ask them to fill out forms.

But when it comes time to actually ask the questions, how do you do it? You cannot just walk up to a thousand people and start chatting without a plan. If you want data that you can actually analyze, compare, and draw conclusions from, you need a standardized list of questions. Every single person must be asked the exact same things, in the exact same way.

This brings us to the two most powerful and widely used tools in statistics for collecting primary data: the Questionnaire and the Schedule.

At first glance, they look exactly the same. Both are just printed (or digital) lists of questions. But the way they are used, who fills them out, and the situations they are built for are completely different. Understanding this difference, and knowing how to write a genuinely good question, is the heart of this chapter.

The Core Difference: Who Holds the Pen?

Before we dive into the deep end, let us clear up the biggest point of confusion. If you take away only one thing from this chapter, let it be this: the difference between a questionnaire and a schedule comes down to who fills in the answers.

To understand why we need both, let us look at the two main methods of using these tools: the Mailed Questionnaire Method and the Enumerator Method.

The Mailed Questionnaire Method

Imagine you are a researcher in Delhi, and you want to study the reading habits of university students across all of India. You need responses from Kashmir to Kerala. Traveling to interview 10,000 students in person would take years and cost a fortune.

Instead, you design a questionnaire. You print it out (or create a digital form) and mail it to the students. Along with the questions, you include a polite cover letter. This letter explains who you are, why this research is important, and assures the student that their answers will be kept secret. If you are sending it by physical post, you also include a stamped, self-addressed envelope so the student does not have to pay to mail it back to you.

The student sits at their desk, reads the questions, ticks the boxes, and mails it back.

Advantages of the Mailed Questionnaire

1. 1Highly Economical: This is the cheapest way to gather primary data. You do not have to hire, train, or pay travel allowances to a team of interviewers. Your only costs are printing, postage, or software subscriptions.
2. 2Massive Coverage: You can reach respondents anywhere in the world. Geography is not a barrier.
3. 3Original and Unbiased: Because the respondent fills it out in private, the data is completely original. There is no interviewer standing over them, which means there is no "interviewer bias" (where a respondent might change their answer to impress or avoid judgment from the person asking).
4. 4Time to Think: Respondents can take their time to check their personal records (like looking up their exact monthly electricity bill) before answering, leading to more accurate data for complex questions.

Limitations of the Mailed Questionnaire

1. 1The Literacy Barrier: This is the biggest flaw. A questionnaire is completely useless if the respondent cannot read and write. It is restricted only to educated populations.
2. 2Low Response Rate: People are busy, lazy, or simply forgetful. When a questionnaire arrives in the mail or inbox, many people just throw it away. A 20% to 30% return rate is often considered a "good" result in mailed surveys.
3. 3Lack of Flexibility: If a respondent does not understand a question, there is nobody there to explain it to them. They might guess the meaning, answer incorrectly, or just leave it blank.
4. 4No Verification: You cannot be entirely sure who actually filled out the form. You might have mailed it to the head of a company, but they might have handed it to their junior assistant to fill out.

The Enumerator Method (Using Schedules)

Now, imagine a different scenario. The Government of India wants to conduct the decennial Census. They need to know the age, occupation, and living conditions of every single household in the country.

They cannot use a mailed questionnaire. Millions of citizens might not be able to read it, and millions more simply wouldn't bother to mail it back. The government needs a 100% response rate, and they need the data to be perfectly accurate.

So, they use the Enumerator Method. They design a schedule. Then, they hire and train thousands of workers called enumerators.

The enumerator takes the schedule, walks up to a house, knocks on the door, and interviews the head of the household. The enumerator reads the questions out loud, translates them into the local language if necessary, and writes the answers down on the schedule themselves.

Advantages of the Enumerator Method

1. 1Works for Everyone: Because the enumerator reads the questions and writes the answers, the respondent does not need to know how to read or write. This is essential for nationwide surveys in countries with varying literacy rates.
2. 2High Response Rate: It is easy to ignore an email, but it is much harder to ignore a polite government worker standing at your door. The response rate is usually very high.
3. 3Accurate and Complete: If a respondent gives a confusing answer, the enumerator can ask follow-up questions to clarify. If a respondent doesn't understand a term, the enumerator can explain it. This results in very few blank or misunderstood questions.
4. 4Visual Verification: The enumerator can observe the surroundings. If a respondent claims they own no luxury goods, but the enumerator sees a massive flat-screen TV and a luxury car in the driveway, the enumerator can note this discrepancy.

Limitations of the Enumerator Method

1. 1Extremely Expensive: You have to pay salaries, travel allowances, and lodging for a whole team of enumerators. This method is usually only affordable for governments, large corporations, or well-funded research institutes.
2. 2Time-Consuming: Training enumerators takes weeks. Then, they have to travel from house to house, which takes months.
3. 3Enumerator Bias: If the enumerator is not trained properly, their tone of voice or body language might influence the respondent's answers. Furthermore, if an enumerator is lazy, they might just sit in a tea shop and fill out the schedules with fake data themselves (a severe problem known as "curb-stoning").
4. 4Lack of Privacy: Respondents might feel shy or scared to give honest answers about sensitive topics (like income, bad habits, or personal health) when speaking face-to-face with a stranger.

Side-by-Side Comparison: Questionnaire vs. Schedule

To make revision easy, here is how the two tools stack up against each other across key parameters:

• Who fills it out?
• Questionnaire: The respondent.
• Schedule: The enumerator.
• Literacy requirement:
• Questionnaire: Respondent must be literate.
• Schedule: Respondent can be illiterate; only the enumerator needs to read and write.
• Cost:
• Questionnaire: Very economical.
• Schedule: Highly expensive.
• Response Rate:
• Questionnaire: Generally low (many non-responses).
• Schedule: Generally high (enumerator ensures completion).
• Personal Contact:
• Questionnaire: None. It is impersonal.
• Schedule: Direct, face-to-face contact.
• Clarification of doubts:
• Questionnaire: Not possible. If a question is confusing, the respondent is stuck.
• Schedule: Easy. The enumerator can explain the question on the spot.

Qualities of a Good Questionnaire (or Schedule)

Whether you are designing a questionnaire to be mailed, or a schedule to be used by an enumerator, the questions themselves must be flawless.

Drafting a good survey is a mix of art and psychology. If your questions are annoying, confusing, or offensive, people will simply stop answering. Here are the golden rules for designing a high-quality questionnaire.

1. Keep it Short and Simple

The number of questions should be as small as possible. If a questionnaire looks like a 20-page exam paper, the respondent will throw it away. Only ask what is strictly necessary for your research.

2. Maintain a Logical Sequence

Questions should flow naturally, like a good conversation. You should use the Funnel Approach: start with broad, easy, general questions to make the respondent comfortable, and slowly narrow down to the specific, detailed, or sensitive questions.

• Bad Sequence: 1. What is your exact annual income? 2. What is your name? 3. Do you like tea?
• Good Sequence: 1. What is your name? 2. Do you consume hot beverages? 3. Which income bracket do you fall into?

3. Use Simple, Everyday Language

Do not use technical jargon, heavy vocabulary, or complex grammar. The question should mean exactly the same thing to every single person who reads it.

• Bad: "What is your household's aggregate demographic composition?"
• Good: "How many people live in your house?"

4. Avoid "Leading" Questions

This is a critical concept. A leading question is one that is worded in a way that pushes or "leads" the respondent toward a specific answer. It puts words in their mouth.

• Leading (Bad): "Don't you agree that the new highway is a waste of taxpayer money?" (This pressures the person to say yes).
• Neutral (Good): "What is your opinion on the construction of the new highway?"

5. Avoid "Double-Barreled" Questions

A double-barreled question asks two different things at the same time, but only allows for one answer. This leaves the respondent confused if they agree with one part but not the other.

• Double-Barreled (Bad): "Are you satisfied with your salary and the cafeteria food?" (What if they love the salary but hate the food? How do they answer?)
• Fixed (Good): Split it into two questions. Q1: "Are you satisfied with your salary?" Q2: "Are you satisfied with the cafeteria food?"

6. Avoid Questions Requiring Calculations

People are doing you a favour by filling out your survey; do not give them math homework.

• Bad: "What percentage of your monthly income do you spend on groceries?" (Most people don't know this off the top of their head and won't bother calculating it).
• Good: "What is your monthly income?" followed by "How much do you spend on groceries in a month?" (The researcher can calculate the percentage later).

7. Provide Clear Instructions

Always tell the respondent exactly how to answer. Should they tick a box? Circle a number? Write in block letters? If a question says "Rank your top 3 choices", make sure it is clear whether 1 means "best" or 3 means "best".

8. Use Multiple Choice Wherever Possible

Open-ended questions (where the respondent writes a paragraph) are very hard to analyze statistically. Whenever possible, give them specific options to choose from (Yes/No, Multiple Choice, or a rating scale from 1 to 5).

The Crucial Final Step: The Pilot Survey

You have drafted your questionnaire. You followed all the rules. It looks perfect on your computer screen. Should you go ahead and print 10,000 copies?

Absolutely not.

Before launching the main survey, every good statistician conducts a Pilot Survey (also known as pre-testing).

Think of it like a movie's test screening. You take your draft questionnaire and give it to, say, 20 or 30 people who are similar to your final audience. You watch them fill it out, or you review their answers.

Why is a Pilot Survey so important?

1. 1It catches confusing questions: You might think a question is perfectly clear, but the pilot survey reveals that half the people misunderstood it.
2. 2It tests the length: If your pilot respondents get bored and quit halfway through, you know your questionnaire is too long and needs to be cut down.
3. 3It checks the options: If you gave a multiple-choice question, but 80% of the pilot respondents are writing their own answers in the margins, you know you missed a crucial option and need to add it.
4. 4It estimates costs and time: It helps you calculate exactly how long one interview takes, which helps you budget for the final, massive survey.

Worked Example: Fixing Bad Questions

To truly master this topic for the exam, you need to be able to spot a bad question instantly. Let us look at a mini case study.

Imagine a researcher is designing a questionnaire about public transport in Jammu. Look at the draft questions below, identify the error, and see how we fix it.

Draft Question 1: "Do you frequently use the minibus service?"

• The Error: Ambiguity. What does "frequently" mean? To one person, it means twice a day. To another, it means twice a month. The data will be useless.
• The Fix: "How many days per week do you use the minibus service?" (Options: 0 days, 1-2 days, 3-5 days, 6-7 days).

Draft Question 2: "Don't you think the government should buy more electric buses to reduce terrible city pollution?"

• The Error: It is a highly leading question. It uses emotional words ("terrible") and pressures the respondent to agree ("Don't you think...").
• The Fix: "Do you support or oppose the purchase of more electric buses for the city?" (Options: Strongly Support, Support, Neutral, Oppose, Strongly Oppose).

Draft Question 3: "Are the bus drivers polite and do they drive safely?"

• The Error: Double-barreled. A driver might be very polite but drive like a maniac. The respondent cannot answer accurately.
• The Fix: Split it. Q1: "How would you rate the politeness of the drivers?" Q2: "How would you rate the safety of their driving?"

Quick Revision

If you are scanning this the night before the exam, here are the absolute highest-yield points to remember:

• Questionnaire: Filled out by the respondent. Cheap, wide coverage, but suffers from low response rates and requires the respondent to be literate.
• Schedule: Filled out by the enumerator (interviewer). Expensive, time-consuming, but guarantees high response rates, accurate data, and works for illiterate populations.
• Cover Letter: Always accompanies a mailed questionnaire to explain the purpose and guarantee privacy.
• Leading Questions: Questions that hint at the "correct" answer or pressure the respondent. They must be strictly avoided.
• Double-Barreled Questions: Asking two things in one sentence. Always split them up.
• Logical Sequence: Questions should go from easy/general to difficult/specific (the funnel approach).
• Pilot Survey: A small trial run of the questionnaire to find mistakes, test the length, and fix confusing wording before the main launch. Never skip it.