A Methodology for Evaluating Algorithms That Calculate Social Influence in Complex Social Networks

Table 7

Main questionnaire given to participants.

The questionnaire contains 6 questions and takes 10 minutes to complete. Your answers will be anonymized and analysed collectively for all publishing or discussion purposes. By participating, you are supporting the final phases of Vanja Smailović’s PhD research. Each of the 6 questions requires reading an imaginary Facebook post. Each question offers several pairs of your Facebook friends which are offered as answers. Your task, for each of the pairs, is to choose the Facebook friend which you consider to be the correct answer for a given question. If the question seems absurd or inapplicable, choose the Facebook friend whom you consider to be MORE correct. Read all the questions in advance—it is advisable to at least skim through them all before proceeding. Important: If the pairs repeat among the 6 questions—choose your answer always while paying attention to the question. On the other hand, watch out for pairs that repeat in a single question—those pairs require the same answer, because their goal is to check consistency. In other words, the same pairs between different questions are allowed to (and can) have a different answer—same pairs within a single question cannot! Do not communicate or consult with others while filling out the questionnaire and remain concentrated. You are allowed to go back in steps—the questionnaire is finalized, submitted, and locked only after you press Submit. In case of any questions or doubts, please call Vanja at [telephone number provided] to avoid making mistakes or errors.
	Question text	Available answers
	You are dissatisfied with your mobile operator. You’ve noticed a post “I’ve moved to my new telco X, I think they are better.” You would more likely change your mobile operator if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs
	You’ve noticed a post “World leaders at their last meeting decided to increase nuclear armament.” You would search for more details if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs
	You’ve noticed a post that explains the proven downside of your preferred political party. You would more likely change your vote if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs
	You’ve noticed a motivational post with thoughts about a brighter future, more jobs and possibilities, and greater salaries where you live. Reading the post would more likely cause peacefulness in you if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs
	You’ve noticed a post “Tensions between Balkan EU members might lead to war.” Reading the post would more likely cause restlessness if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs
	You are planning on seeing the movie X. You’ve noticed a post “I’ve seen X, it’s horrible.” Reading the post would more likely dissuade you from watching the film if it were posted by your Facebook friend: _______ or _______	12 Facebook-friend pairs