Taking a break from the spam to open this thread to help answer any questions about polling methodology or statistics as we go into the US election polling season.

THIS IS NOT A PLACE TO COLLECT RESPONSES TO YOUR SURVEY. PLEASE FOR THE LOVE OF GOD

We are having thousands of kids in Central America fill out a paper survey. We need to scan in the survey responses into some digital format. The answers include both multiple choice and text write-in. The survey and the responses will be in Spanish.

What are good paid services?

What are good free open-source software?

Thanks!

I am working on a project for a class I am in using Qualtrics. I messed up and did not calculate the number of days accurately so now I have 9 days to answer a survey 10 times on 10 different days. Is there any way I can change the date on my survey answers or somehow make Qualtrics think it is yesterday so I can take the survey yesterday?

I have a new research job and I am tasked with building an extensive Qualtrics survey. My supervisor wants there to be specific ways that we can ask questions. I am wondering specifically about the dropdown section and .csv files. If anyone has time to chat or zoom this week I'd greatly appreciate it!!

I'm in an entrepreneurship class and I made a survey for people to say what they think about my product. However, I'm having trouble trying to find people to answer them. Is there a way I can easily find respondents to my survey for free? (I made my survey on a google form).

Im currently building my dissertation survey in qualtrics but have come to some real issues with logics, and loops and merges. Some help would be really appreciated. Thanks, in advance.

I'm trying to have a block which splits off into two different branches depending on the answer to the first 'yes / no' question, then for one of the branches, have the final question as a 'yes / no' question and if the answer is yes, the loop repeats until no is answered.

I'm currently using a skip logic for the first question if answered no which skips to the next block. If yes is answered, I'm using 'if yes selected' logics to show the questions in reference to this first question. However when I try to loop my last question of "Do you use anything else?", back to the first question in the branch, the whole branch won't be displayed.

What is your advice to do to try to fix this issue?

Hi survey researchers,

For the past year I've been trying to build a survey software with the goal of incentivizing better data and increase the response & completion rate. We focused a lot on UI/UX and the application of really small incentives, which can be customized for every question. So if you experienced a bottleneck in your survey or you're asking a hard question that requires a lot of time and effort from the respondents, you could issue a higher incentive for that question. E.g. plant 10% of a tree for question 1 and 30% of a tree for question 2. Our thesis is that people spend to much money on incentives that research suggest dont really work, such as raffles and sweepstakes.

Now I'm not sure if that is a big enough problem for you, so I wanted to know what you think and ask if you face any particular problem using survey software (what ever it is) where you would like to see a solution.

I need to use a single form, in this (simplified) structure:

I'm a.. (teacher / student) what's up? (good / bad) 

I'll use this one form for different schools, so the outcome will be something like:

1 | school A | teacher | good 
2 | school A | teacher | bad 
3 | school A | student | bad 
4 | school B | student | good 
5 | school B | student | bad 
6 | school C | teacher | good 

Hence I'll need to use a hidden field, with a prefilled link for each school:

School A > form.com/?school=school+A 
School B > form.com/?school=school+B

The only tool I found that has this behavior enabled, AND supports RTL, is 123FormBuilder. Is there any other?

Google Forms allows prefilled links, but the user has to keep the prefilled value while submitting. If the prefilled link is hidden, the data will not be sent.

Airtable seems to allow prefilled hidden fields, but it does not support RTL.

Anyone know of a survey tool that allows for conditional text blocks? Not just conditional logic for which questions, but blocks of text that are shown.

I’m building a screening survey and someone could be eligible for any combination of A and/or B and/or C. I’m currently using Typeform and I can make multiple endings — A, AB, ABC, etc — but I’d like one ending with multiple blocks of text that are turned on or off based on responses.

I am designing a survey on that will be deployed in both English and French (Quebecois or Canadian French, to be precise). The English version of the survey has been professionally translated, and it looks very good as far as I can tell (though I have to rely on high school french and Google translate to check this!). One concern I have, though, is with a five-point Likert scale to be used by respondents to evaluate a number of statements.

My original English scale is:

• Strongly disagree
• Disagree
• Neither disagree nor agree
• Agree
• Strongly agree

The professional translator rendered this as:

• Fortement en désaccord
• En désaccord
• Neutre
• En accord
• Fortement en accord

A French colleague (European French, though conscious of the Quebecois deployment) suggested this:

• Fortement opposé
• Opposé
• Sans opinion
• D'accord
• Tout à fait d'accord

What I find interesting is how little attention this has received in the literature. Most bilingual (French/English) examples I've seen that use a "strongly disagree" / "strongly agree" Likert scale only label the end-points, and do so as « fortement en désaccord » / « fortement en accord ».

Even so, this article (see Haggerty, J. L., Bouharaoui, F., & Santor, D. A. (2011). Differential item functioning in primary healthcare evaluation instruments by french/english version, educational level and urban/rural location. Healthcare Policy, 7, 47–65.) argues it's more nuanced than that:

• “strongly disagree” seems to be more negative than « fortement en désaccord ». « Pas du tout d'accord » ("not at all in agreement") might be a better translation of “strongly disagree”.
• They detected differences in how response options were interpreted between "agree" and "disagree". The observed difference suggests that "disagree" may not be equivalent to « désaccord »; rather, it seems to be a different concept rather than the opposite of « accord » (though they don't suggest an alternative).
• They also suggest "strongly agree" / « fortement en accord » might be problematic but don't offer a suggestion.

TL;DR:

• Should "strongly disagree" be translated as « Fortement en désaccord », « Pas du tout d'accord », « Fortement opposé », or something else?
• Should "disagree" be translated as « en désaccord » or «ne pas d'accord », « opposé », or something else?
• Should "neither disagree nor agree" be translated as « ni en désaccord ou en accord », « neutre », or « sans opinion », or something else?
• Should "agree" be translated as « d'accord » or « en accord », or something else?
• Should "strongly agree" be translated as « fortement en accord », « entièrement d'accord », « tout à fait d'accord », or something else?

Appreciate any thoughts, especially references to research where these differences have actually be tested. Seems like it would be a good area for some survey validation research if it hasn't already been done.

(P.S.: I'm also dealing with a similar problem for a four-point scale — accept, accept with some concerns, have concerns but not object, have significant concerns and strongly object — that is raising similar translation challenges, but that's another story ...).

Hi all! I’m creating a survey in question pro and I’m getting a “next question” button after a multi-point scale structured question, but not after any of the other types of questions. Is there a way to make this go away?

We want the survey so be as open as possible and don’t want respondents to think they’re forced to answer the question before going on to the next. I already have it set to auto-advance questions but the button still appears for these specific questions.

Thanks!

Hello!

I need thoughts on a survey application that can handle question grids/ matrix where the questions are of different types (multiple choice, numeric, text entry) within the same row (See example below).

Ideally, it should also be

- for ios and andorid

- free or affordable

- must work offline and be editable in the field

We can't find anything, have tried three options (epicollect, qualtrics, and kobocollect) all which fail with this question grid layout in the app.

Really need advice!

https://preview.redd.it/i13nkryme80a1.png?width=2044&format=png&auto=webp&s=f63765bbaed1dd4b4a00a8c367d5c63baba76663

Frequent Failures in Unipark you should avoid in advance

Hey guys I want to collect some tips/tricks/advices for those who work with unipark (questback). What advices to you have or what bad experiences did you make that will help others in advance. Also links for good tutorials are welcomed!

Thank you my collegues!

Guys, i'm an undergraduate college student and i have to write a survey paper for my upcoming project. I have no idea how to write one, and what exactly a survey paper contains. Can some of you please guide me on where to look for some details or where and how to start? Thank you

I'm designing feedback surveys for our customers (a digital service) and can't really find insights into best practices. Tech and social media are changing so frequently, I'd love to stay up to date.

What are the trends in 2022? Open vs. Closed questions, Frequency, Compiling data etc.

Could anyone point me in the direction of a site, podcast or book? It's hard to find quality resources.

We made a survey and are offering a gift card to participants. We don't want people who are under 19 however to have access to the link that leads to the drawing survey. It's in the end block description at the moment. I'd appreciate any help.

Hello, I was wondering if there is a specific Reddit page (if not here), where I can post a link to my survey.

Hi all, I'm looking for a tool that allows my org to create a survey with multiple sub-surveys that people can choose to fill out. To clarify what I mean, we have a need for people that did work in multiple areas to pick and choose which of those things they worked on, and answer questions about them accordingly.

i.e. We had projects A, B, C, and D that our folks participated in. Person 1 worked on projects B and D, so we'd like for them to access the survey, pick those two projects only, and answer questions about them.

The main idea is we want participants to easily choose which of the projects they worked on through one survey for ease of access. Any help or suggestions for how to handle this if there aren't tools capable of doing so is greatly appreciated as well!

We do a lot of ad-hoc surveying at my job that typically uses the same 5-6 types of question formats (select one, select all, 5-scale likert, etc). As a result, I see a lot of opportunity for automation. I’ve explored creating an R package that codes these different types of questions that we can use as opposed to do doing it by hand in Excel every time. However, I’m not sure if this is the best method? What would you all recommend as being the best course of action?

Thank you!

Hello. Does anyone know how to code JavaScript for a two-handle slider (provides min and max) in Qualtrics? I would really appreciate it. Thank you!

So I’m doing a research paper on child abuse . My variables are Age , Socioeconomic status and life experiences.

If I wanted to write on life experiences would that also be considered too close as too age ? Or is that fine?

For example-

For age I’m planning to write how it affects a person throughout their lifespan.

And for life experiences I wanted to write about how it affects their emotional well-being. Mental ability , how one copes with things, relationships , like yea life experiences and how impacts the person and the way that they view the world. Etc etc

Would it be considered the same variable because they sound so similar ?

Thanksss

i need help folks! I am a beginner so treat me kindly :)

I am having trouble to copy one of the scales i am going to use in my thesis research to the qualtrics system; because every item in the scale has two questions. The scale consists of hypothetical situations. For example first question requires participant to assume something and how common he/she would be anxious considering this assumption and additionally it asks what would he/she expect others to do (Both questions will be answered on Likert scale). How can i transfer this scale so that participants won't be confused?

It has to be seen like in the first screenshot starting with romantik partner... etc. However I had to copy it as if there are two items (second screenshot), yet it is only one item with two questions.

https://preview.redd.it/w47uvvhdrls91.png?width=782&format=png&auto=webp&s=676373230c74eca005aa653e6cd7bda9cae9c929

https://preview.redd.it/wpbpg0varls91.png?width=1358&format=png&auto=webp&s=7e503bbd475320afc961c1a961b4b99ee486fe99

Hey all, I am doing a small project for a class and I want to survey people to see how visuals in concert films impact the reaction people have to the music. I want to have people listen to a song/watch it in the film and then rate it, but I am not sure what the best way to go about it would be. The two ways I am thinking are:

1. A group of people first listens to the songs and gives an initial rating. Some time later, they watch the clip of that song in the film and give it a second rating.

or

2. I gather two groups of people, one listens to the songs and the other watches the movie clips, and they are both asked to rate the song.

Does anyone have any recommendation on which one would be better? Thanks!

Edit: Thanks for all the responses! They are very helpful. I will do a variation of 1.

I have participants watching 4 videos and then answering recall questions. Right now I have both unaided and aided recall questions (3 point scale on whether they remember certain elements of the ad), but the survey is too long with both. What is the best way to go about measuring recall?

Hi there,

I am currently searching for an answer or reference to a source that can give me an answer to the following use case/ situation:

​

Disclaimer: I have little to no knowledge when it comes to statistics. Total beginner.

​

Question:

Does it make sense to weight a sample to remove an imbalance, even if you are not trying to infer or conclude anything about a larger population, but just work descriptively?

​

Context:

I am in the middle of analysing a data set from an internet survey I have done resently. I will not use inferential statistics, because:

1. I could not find reliable statistics/ numbers on the target population, I am analysing, which are people working in the motion picture industry (worldwide).
2. The survey was fielded via a non-probability sampling (convenience sampling), thus not random and not representitive of the population I tried to field/ analyse.

I want to focus "only" on the sample itself and analyze it descriptively to find some interesting data points that relate only to the sample.

​

Example:

The distribution of respondents from different production environments who participated in the survey is not balanced. Not that it would be exactly equal if I had access to the "actual" distribution/numbers of which production environment people work in.

Recorded distribution:

• grp1 at 48%
• grp2 at 22%
• grp3 at 16%
• grp4 at 14%

Since the share of grp1 is noticeably higher than the other groups the data set „misrepresents“ other aspects of the sample. Especially if I am trying to analyse multiple together.

​

Since I am a totally new to this, I find it difficult to articulate what I am trying to find out and whether weighting descriptive data is something one should do.

Thanks in advance to everyone taking the time to help. Kind regards

Jobbel

Hi! Just wondering if anyone has experience with their Qualtrics survey being bombarded by bots? It's a public link, password protected, every security feature enabled, and we're still getting swarmed, even after duplicating the survey and making a new link. We can't use personal links due to the size of the sample needed but it is password protected. Thanks!

**Details:**

​

I have several datasets of multiple response survey questions where users were shown a list of attributes and asked to indicate those attributes they value. Responses were recorded as either yes or no. Each option set was shown to a different random sample of respondents.

​

The option sets have significant, but not perfect overlap with one another. Some response options are common among the option sets and some are less common.

​

*Example*

​

option set A = {adaptable, balanced, confident, courageous}

​

option set B = {balanced, curious, daring, determined}

​

option set C = {adaptable, balanced, curious, determined}

​

option set n = {...}

​

​

Where the data might look something like this:

​

​

| | adaptable | balanced | confident | courageous |

|--------------|-----------|----------|-----------|------------|

| respondent 1 | 0 | 1 | 1 | 0 |

| respondent 2 | 1 | 1 | 0 | 0 |

| respondent 3 | 0 | 1 | 0 | 1 |

| respondent n | ... | ... | ... | ... |

​

​

**Question:**

​

In order to calculate preference for one set, you can obviously just sum the columns to get a frequency table.

​

My first guess was to simply take the relative frequency of each value, but I'm curious, what other techniques can you use to calculate the preference across multiple sets?

​

Essentially I would like to be able to answer preference for "adaptable" across {A,B,C}.

​

I assume there may be multiple approaches. I'd love to hear what they are and their benefits or shortcomings.