The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content

Roman Lukyanenko
Roman Lukyanenko
[email protected]
College of Business, Florida International University, Miami, Florida 33199
Search for more papers by this author
,
Jeffrey Parsons
Jeffrey Parsons
[email protected]
Faculty of Business Administration, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada
Search for more papers by this author
,
Yolanda F. Wiersma
Yolanda F. Wiersma
[email protected]
Department of Biology, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada
Search for more papers by this author

Roman Lukyanenko

[email protected]

College of Business, Florida International University, Miami, Florida 33199

Search for more papers by this author

Jeffrey Parsons

[email protected]

Faculty of Business Administration, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada

Search for more papers by this author

Yolanda F. Wiersma

[email protected]

Department of Biology, Memorial University of Newfoundland, St. John’s, Newfoundland A1B 3X5 Canada

Search for more papers by this author

Published Online:13 Oct 2014https://doi.org/10.1287/isre.2014.0537

Supplemental Material

isre.2014.0537-sm-onlinesupplement.pdf (39 KB)

Cited by
- Contribute to MY IT Service: Encouraging Technology Extra-Role Behaviors in User-Artifact Interactions from a Psychological Ownership Perspective
  Haiyun (Melody) Zou,
  Yulin Fang,
  Heshan Sun,
  Kai H. Lim
  16 March 2026 | Information Systems Research, Vol. 0, No. 0
- Sustainable Use Intention of Text-to-Image Generative AI in Higher Education: An S–O–R Model with Parallel Trust and Risk Pathways
  5 February 2026 | Sustainability, Vol. 18, No. 3
- The gap matters: An explainable customer dissatisfaction tracing analysis
  Information & Management, Vol. 63, No. 1
- Performance of Algorithmic Models and Sensitivity to Crowd Characteristics: Evidence from Cross-Platform Posting
  1 December 2025 | MIS Quarterly, Vol. 49, No. 4
- Task performance and platform commitment: the role of job design and worker motivation in microtasking crowdsourcing
  27 October 2025 | Frontiers in Organizational Psychology, Vol. 3
- Impact of categorization autonomy on effective use and adoption intentions
  Decision Support Systems, Vol. 196
- The state-of-the-art of crowdsourcing systems: A computational literature review and future research agenda using a text analytics approach
  Information & Management, Vol. 62, No. 2
- Social media and cost of debt financing: Evidence from stock forum text analysis
  28 May 2024 | Journal of Financial Research, Vol. 48, No. 1
- Do Crowds Validate False Data? Systematic Distortion and Affective Polarization
  1 March 2025 | MIS Quarterly, Vol. 49, No. 1
- Bring Your Own Bug: Enabling User-Generated Content in Serious Games for Industrial Cybersecurity and AppSec Education
  2 June 2025
- Uncovering How Information Quality Shapes Diverse User Engagement on Content Community Platforms: Harnessing Deep Learning for Feature Extraction
  4 October 2024 | Journal of Theoretical and Applied Electronic Commerce Research, Vol. 19, No. 4
- A local community on a global collective intelligence platform: A case study of individual preferences and collective bias in ecological citizen science
  26 August 2024 | PLOS ONE, Vol. 19, No. 8
- Distilling wisdom of crowds in online communities: A novel prediction market constructed with comment posters
  Decision Support Systems, Vol. 180
- Fake news on Social Media: the Impact on Society
  19 January 2022 | Information Systems Frontiers, Vol. 26, No. 2
- The many faces of social media in business and economics research: Taking stock of the literature and looking into the future
  23 June 2023 | Journal of Economic Surveys, Vol. 38, No. 2
- Advantages and Drawbacks of Open-Ended, Use-Agnostic Citizen Science Data Collection: A Case Study
  22 February 2024 | Citizen Science: Theory and Practice, Vol. 9, No. 1
- Taking the Chat out of Chatbot? Collecting User Reviews with Chatbots and Web Forms
  19 February 2024 | Journal of Management Information Systems, Vol. 41, No. 1
- The use of dietary supplements and vitamin consumption during and after the Covid pandemic in Vietnam: a perspective of user-generated content
  21 November 2023 | Humanities and Social Sciences Communications, Vol. 10, No. 1
- Lying in online social networks: a bug or a feature
  17 July 2023 | Journal of Information, Communication and Ethics in Society, Vol. 21, No. 4
- Freelisting: A Research Guide for Information Systems Researchers
  30 October 2023 | ACM SIGMIS Database: the DATABASE for Advances in Information Systems, Vol. 54, No. 4
- Deep Learning-Based Imputation Method to Enhance Crowdsourced Data on Online Business Directory Platforms for Improved Services
  17 June 2023 | Journal of Management Information Systems, Vol. 40, No. 2
- Exploring Stigmergic Collaboration and Task Modularity Through an Expert Crowdsourcing Annotation System: The Case of Storm Phenomena in the Euro-Atlantic Region
  IEEE Access, Vol. 11
- Privilege or equality? A natural experiment with content monetization in social media
  Information & Management, Vol. 59, No. 8
- Managing Users’ Behaviors on Open Content Crowdsourcing Platform
  22 October 2021 | Journal of Computer Information Systems, Vol. 62, No. 6
- Information Control for Creator Brand Management in Subscription-Based Crowdfunding
  Yu-Kai Lin,
  Arun Rai,
  Yukun Yang
  29 December 2021 | Information Systems Research, Vol. 33, No. 3
- System: A core conceptual modeling construct for capturing complexity
  Data & Knowledge Engineering, Vol. 141
- Seekers’ complaint behavior in crowdsourcing: An uncertainty perspective
  Journal of Retailing and Consumer Services, Vol. 68
- Skipping class: improving human-driven data exploration and querying through instances
  29 January 2021 | European Journal of Information Systems, Vol. 31, No. 4
- Crowd wisdom and internet searches: What happens when investors search for stocks?
  International Review of Financial Analysis, Vol. 82
- The power of beauty: Be your ideal self in online reviews—an empirical study based on face detection
  Journal of Retailing and Consumer Services, Vol. 67
- Combining Crowd and Machine Intelligence to Detect False News on Social Media
  1 June 2022 | MIS Quarterly, Vol. 46, No. 2
- Analysing the value of environmental citizen-generated data: Complementarity and cost per observation
  Journal of Environmental Management, Vol. 303
- Constructs and Indicators: An Ontological Analysis
  1 December 2021 | MIS Quarterly, Vol. 45, No. 4
- Foundations of information technology based on Bunge’s systemist philosophy of reality
  18 January 2021 | Software and Systems Modeling, Vol. 20, No. 4
- Exploring the invisible college of citizen science: questions, methods and contributions
  23 June 2021 | Scientometrics, Vol. 126, No. 8
- Reviews Left and Right: The Link Between Reviewers’ Political Ideology and Online Review Language
  28 May 2020 | Business & Information Systems Engineering, Vol. 63, No. 4
- Improving food shopping behaviour: A model-based review of mobile applications to assist with healthy and sustainable grocery shopping
  Computers in Human Behavior Reports, Vol. 4
- An Approach to Improve the Quality of User-Generated Content of Citizen Science Platforms
  25 June 2021 | ISPRS International Journal of Geo-Information, Vol. 10, No. 7
- Identifying comparable entities from online question-answering contents
  Information & Management, Vol. 58, No. 3
- Le pouvoir de Facebook
  15 March 2021 | Balisages, No. 2
- Examining the Influence of Digital Information Quality on Tourists’ Experience
  6 June 2020 | Journal of Quality Assurance in Hospitality & Tourism, Vol. 22, No. 2
- The Readiness of Social Media Back-End to Support Surabaya Government’s Public Policy
  IOP Conference Series: Earth and Environmental Science, Vol. 717, No. 1
- From Representation to Mediation: A New Agenda for Conceptual Modeling Research in a Digital World
  1 March 2021 | MIS Quarterly, Vol. 45, No. 1
- (Un)theorizing citizen science: Investigation of theories applied to citizen science studies
  9 October 2019 | Journal of the Association for Information Science and Technology, Vol. 71, No. 8
- Citizen Science: An Information Quality Research Frontier
  10 April 2019 | Information Systems Frontiers, Vol. 22, No. 4
- Crowdsourcing Content Creation for SQL Practice
  15 June 2020
- Developing a Digital Twin at Building and City Levels: Case Study of West Cambridge Campus
  Journal of Management in Engineering, Vol. 36, No. 3
- Crowd characteristics and crowd wisdom: Evidence from an online investment community
  15 May 2019 | Journal of the Association for Information Science and Technology, Vol. 71, No. 4
- Managerial Responses and Customer Engagement in Crowdfunding
  21 April 2020 | Sustainability, Vol. 12, No. 8
- Information Technology (IT) enabled crowdsourcing: A conceptual framework
  Information Processing & Management, Vol. 57, No. 2
- Article 8. Fondements des technologies de l’information d’après la philosophie systémiste de la réalité de Bunge
  Mεtascience, Vol. N° 2, No. 2
- Easier Crowdsourcing Is Better: Designing Crowdsourcing Systems to Increase Information Quality and User Participation
  24 September 2020
- A Journey to BSO: Evaluating Earlier and More Recent Ideas of Mario Bunge as a Foundation for Information Systems and Software Development
  29 May 2020
- Collecting Repurposable Data from the Crowd: The Role of Information Diversity
  1 January 2020 | SSRN Electronic Journal, Vol. 18
- Is online multiple-stores cooperative promotion better than single-store promotion? Misprediction from evaluation mode
  Information & Management, Vol. 56, No. 7
- Comparing digital libraries with social media from the dual route perspective
  Online Information Review, Vol. 43, No. 4
- Potential Problem Data Tagging: Augmenting information systems with the capability to deal with inaccuracies
  Decision Support Systems, Vol. 121
- Expecting the Unexpected: Effects of Data Collection Design Choices on the Quality of Crowdsourced User-Generated Content1
  1 June 2019 | MIS Quarterly, Vol. 43, No. 2
- Facebook’s power: factors influencing followers’ visit intentions
  Spanish Journal of Marketing - ESIC, Vol. 23, No. 1
- Representing instances: the case for reengineering conceptual modelling grammars
  3 July 2018 | European Journal of Information Systems, Vol. 28, No. 1
- Chronological Semantics Modeling: A Topic Evolution Approach in Online User-Generated Medical Data
  5 June 2019
- Developing a Dynamic Digital Twin at a Building Level: using Cambridge Campus as Case Study
  5 July 2019
- Combining Crowd and Machine Intelligence to Detect False News in Social Media
  SSRN Electronic Journal, Vol. 63
- What Motivates the Crowd?
- The Dynamics of Social Media and Value Co-Creation
- Beyond Micro-Tasks
- Beyond Micro-Tasks
- Towards a theory of SocioCitizenry: Quality anticipation, trust configuration, and approved adaptation of governmental social media
  International Journal of Information Management, Vol. 43
- Embeddedness, Prosociality, and Social Influence: Evidence from Online Crowdfunding1
  1 December 2018 | MIS Quarterly, Vol. 42, No. 4
- Comparison of consumers’ perspectives on different health information exchange (HIE) mechanisms: an experimental study
  International Journal of Medical Informatics, Vol. 119
- Implementing and evaluating a citizen‐science program to support wildlife management: MI‐MAST
  13 August 2018 | Wildlife Society Bulletin, Vol. 42, No. 3
- Categorization
  18 June 2018
- Advances in Social Media Research: Past, Present and Future
  6 November 2017 | Information Systems Frontiers, Vol. 20, No. 3
- Crowdsourcing: A Review and Suggestions for Future Research
  19 January 2017 | International Journal of Management Reviews, Vol. 20, No. 2
- Overview of Data Storing Techniques in Citizen Science Applications
  31 August 2018
- CrowdSheet: An Easy-To-Use One-Stop Tool for Writing and Executing Complex Crowdsourcing
  17 May 2018
- Designing for Information Quality in the Era of Repurposable Crowdsourced User-Generated Content
  5 June 2018
- Is Online Multiple-Stores Cooperative Promotion Better than Single-Store Promotion? Misprediction from Evaluation Mode
  SSRN Electronic Journal, Vol. 38
- Beyond Micro-Tasks
  Journal of Database Management, Vol. 29, No. 1
- Are All Classes Created Equal? Increasing Precision of Conceptual Modeling Grammars
  28 September 2017 | ACM Transactions on Management Information Systems, Vol. 8, No. 4
- Compatible quality of social media content: Conceptualization, measurement, and affordances
  International Journal of Information Management, Vol. 37, No. 6
- Crowdsourcing for agricultural applications: A review of uses and opportunities for a farmsourcing approach
  Computers and Electronics in Agriculture, Vol. 142
- The impact of query precision on returned data precision criterion
- The Data Repurposing Challenge
  30 June 2017 | Journal of Data and Information Quality, Vol. 8, No. 3-4
- The bullwhip effect on inventory: a perspective on information quality
  19 October 2016 | Applied Economics, Vol. 49, No. 24
- A Tale of Two Crowds: Public Engagement in Plankton Classification
  11 April 2017 | Frontiers in Marine Science, Vol. 4
- Evaluating citizen vs. professional data for modelling distributions of a rare squirrel
  27 May 2016 | Journal of Applied Ecology, Vol. 54, No. 2
- Editor’s Comments
  1 March 2017 | MIS Quarterly, Vol. 41, No. 1
- Crowdsourcing as a business model
  Journal of Global Operations and Strategic Sourcing, Vol. 10, No. 1
- Towards a Conceptualization of Data and Information Quality in Social Information Systems
  19 December 2016 | Business & Information Systems Engineering, Vol. 59, No. 1
- Understanding Benefits and Limitations of Unstructured Data Collection for Repurposing Organizational Data
  29 August 2017
- What Makes a Good Collaborative Knowledge Graph: Group Composition and Quality in Wikidata
  3 September 2017
- Thirty Years Later
  Journal of Database Management, Vol. 28, No. 1
- Value co-creation between firms and customers: The role of big data-based cooperative assets
  Information & Management, Vol. 53, No. 8
- Doing Public Participation on the Geospatial Web
  1 July 2016 | Annals of the American Association of Geographers, Vol. 106, No. 5
- Information Quality Research Challenge
  1 February 2016 | Journal of Data and Information Quality, Vol. 7, No. 1-2
- Leveraging Pattern Recognition Consistency Estimation for Crowdsourcing Data Analysis
  IEEE Transactions on Human-Machine Systems, Vol. 46, No. 3
- Emerging problems of data quality in citizen science
  13 April 2016 | Conservation Biology, Vol. 30, No. 3
- Sentimental interplay between structured and unstructured user-generated contents
  Online Information Review, Vol. 40, No. 1
- Designing Information as a By-Product
  10 May 2016
- Research on conceptual modeling: Themes, topics, and introduction to the special issue
  Data & Knowledge Engineering, Vol. 98
- Designing for Citizen Data Analysis
  18 April 2015
- Information Quality Research Challenge: Adapting Information Quality Principles to User-Generated Content
  4 March 2015 | Journal of Data and Information Quality, Vol. 6, No. 1
- Guidelines for Establishing Instantiation Validity in IT Artifacts: A Survey of IS Research
- Extending Participatory Design Principles to Structured User-Generated Content
  23 July 2015
- Principles for Modeling User-Generated Content
  8 December 2015

cover image Information Systems Research

Volume 25, Issue 4

Special Section: Information, Technology, and the Changing Nature of Work

December 2014

Pages 667-891

Article Information

Supplemental Material

Metrics

Information

Received:May 04, 2012
Published Online:October 13, 2014

Cite as

Roman Lukyanenko, Jeffrey Parsons, Yolanda F. Wiersma (2014) The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content. Information Systems Research 25(4):669-689.

https://doi.org/10.1287/isre.2014.0537

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

The IQ of the Crowd: Understanding and Improving Information Quality in Structured User-Generated Content

Supplemental Material

Volume 25, Issue 4

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News