Advancing Next-Generation Multimethod Research in Information Systems: A Framework and Some Recommendations for Authors and Evaluators

References

  • Abbasi A, Parsons J, Pant G, Sheng ORL, Sarker S (2024) Pathways for design research on artificial intelligence. Inform. Systems Res. 35(2):441–459.LinkGoogle Scholar
  • Agar MH (1986) Speaking of Ethnography, vol. 2 (Sage, Thousand Oaks, CA).CrossrefGoogle Scholar
  • Ahlberg C, Shneiderman B (1994) Visual information seeking: Tight coupling of dynamic query filters with starfield displays. Proc. SIGCHI Conf. Human Factors Comput. Systems (CHI ’94) (Association for Computing Machinery, New York), 313–317.Google Scholar
  • Athey S, Bayati M, Doudchenko N, Imbens G, Khosravi K (2021) Matrix completion methods for causal panel data models. J. Amer. Statist. Assoc. 116(536):1716–1730.CrossrefGoogle Scholar
  • Bapna R, Dellarocas C, Rice S (2010) Vertically differentiated simultaneous Vickrey auctions: Theory and experimental evidence. Management Sci. 56(7):1074–1092.LinkGoogle Scholar
  • Bardhan I, Kohli R, Oborn E, Mishra A, Tan CH, Tremblay MC, Sarker S (2025) Human-centric information systems research on the digital future of healthcare. Inform. Systems Res. 36(1):1–20.LinkGoogle Scholar
  • Bar-Gill S, Inbar Y, Reichman S (2021) The impact of social vs. nonsocial referring channels on online news consumption. Management Sci. 67(4):2420–2447.LinkGoogle Scholar
  • Benthaus J, Risius M, Beck R (2016) Social media management strategies for organizational impression management and their effect on public perception. J. Strategic Inform. Systems 25(2):127–139.CrossrefGoogle Scholar
  • Bryman A (2007) Barriers to integrating quantitative and qualitative research. J. Mixed Methods Res. 1(1):8–22.CrossrefGoogle Scholar
  • Chen KY, Wang J, Lang Y (2022) Coping with digital extortion: An experimental study of benefit appeals and normative appeals. Management Sci. 68(7):5269–5286.LinkGoogle Scholar
  • Cornelissen JP (2025) The problem with propositions: Theoretical triangulation to better explain phenomena in management research. Acad. Management Rev. 50(2):342–365.CrossrefGoogle Scholar
  • Creswell JW, Plano Clark VL (2018) Designing and Conducting Mixed-Methods Research, 3rd ed. (SAGE Publications, Los Angeles).Google Scholar
  • Danatzis I, Chandler JD, Akaka MA, Ng IC (2024) Designing digital platforms for social justice: Empowering end users through the Dataswyft platform. MIS Quart. 48(4):1771–1802.CrossrefGoogle Scholar
  • Dickhaut E, Janson A, Söllner M, Leimeister JM (2024) Lawfulness by design—Development and evaluation of lawful design patterns to consider legal requirements. Eur. J. Inform. Systems 33(4):441–468.CrossrefGoogle Scholar
  • Faik I, Sengupta A (2024) Inclusion by design: Requirements elicitation with digitally marginalized communities. MIS Quart. 48(1):219–244.CrossrefGoogle Scholar
  • Fitzgerald B, Howcroft D (1998) Competing dichotomies in IS research and possible strategies for resolution. Internat. Conf. Inform. Systems (ICIS) 1998 Proc. (Association for Information Systems, Atlanta), 14.Google Scholar
  • Fügener A, Grahl J, Gupta A, Ketter W (2021) Will humans-in-the-loop become borgs? Merits and pitfalls of working with AI. MIS Quart. 45(3):1527–1556.CrossrefGoogle Scholar
  • Geva H, Oestreicher-Singer G, Saar-Tsechansky M (2019) Using retweets when shaping our online persona. MIS Quart. 43(2):501–A20.CrossrefGoogle Scholar
  • Gneezy U, Imas A (2017) Lab in the field: Measuring preferences in the wild. Handbook of Economic Field Experiments, vol. 1 (North-Holland, Amsterdam), 439–464.CrossrefGoogle Scholar
  • Gopal A, Chen PY, Oh W, Xu SX, Sarker S (2024) On crafting effective theoretical contributions for empirical papers in economics of information systems: Some editorial reflections. Inform. Systems Res. 35(3):917–935.LinkGoogle Scholar
  • Haag S, Eckhardt A, Venkatesh V (2022) Deviant affordances: When tensions, deadlocks, and nonconformance generate performance. MIS Quart. 46(4):2111–2162.CrossrefGoogle Scholar
  • Herath Pathirannehelage S, Raj SY, von Krogh G (2025) Design principles for artificial intelligence-augmented decision making: An action design research study. Eur. J. Inform. Systems 34(2):207–229.CrossrefGoogle Scholar
  • Huang N, Wang L, Hong Y, Lin L, Guo X, Chen G (2024) When the clock strikes: A multimethod investigation of on-the-hour effects in online learning. Inform. Systems Res. 35(2):766–782.LinkGoogle Scholar
  • Hunter AD, Brewer J (2015) Designing multimethod research. The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (Oxford University Press, Oxford, UK), 185–205.Google Scholar
  • Johnson RB, Onwuegbuzie AJ (2004) Mixed methods research: A research paradigm whose time has come. Ed. Res. 33(7):14–26.CrossrefGoogle Scholar
  • Johnson SL, Gray P, Sarker S (2019) Revisiting IS research practice in the era of big data. Inform. Organ. 29(1):41–56.CrossrefGoogle Scholar
  • Klein HK, Myers MD (1999) A set of principles for conducting and evaluating interpretive field studies in information systems. MIS Quart. 23(1):67–93.CrossrefGoogle Scholar
  • Lee AS (1991) Integrating positivist and interpretive approaches to organizational research. Organ. Sci. 2(4):342–365.LinkGoogle Scholar
  • Lei Z, Yin D, Zhang H (2021) Focus within or on others: The impact of reviewers’ attentional focus on review helpfulness. Inform. Systems Res. 32(3):801–819.LinkGoogle Scholar
  • Li J, Larsen K, Abbasi A (2020) TheoryOn: A design framework and system for unlocking behavioral knowledge through ontology learning. MIS Quart. 44(4):1733–1772.CrossrefGoogle Scholar
  • Liang C, Hong Y, Gu B (2025) Monitoring and the cold start problem in digital platforms: Theory and evidence from online labor markets. Inform. Systems Res. 36(1):600–620.LinkGoogle Scholar
  • Maruping LM, Yin D, Chen A, Kankanhalli A, Burton-Jones A, Brown SA (2025) Quantitative behavioral IS research—A look back and a look forward. MIS Quart. 49(1):iii–xviii.CrossrefGoogle Scholar
  • Maxwell JA, Chmiel M, Rogers SE (2015) Designing integration in multimethod and mixed methods research. Hesse-Biber SN, Johnson RB, eds. The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (Oxford Library of Psychology, Oxford, UK).Google Scholar
  • Mingers J (2001) Combining IS research methods: Towards a pluralist methodology. Inform. Systems Res. 12(3):240–259.LinkGoogle Scholar
  • Mingers J (2003) A classification of the philosophical assumptions of management science methods. J. Oper. Res. Soc. 54(6):559–570.CrossrefGoogle Scholar
  • Mingers J, Mutch A, Willcocks L (2013) Critical realism in information systems research. MIS Quart. 37(3):795–802.CrossrefGoogle Scholar
  • Molina-Azorin J, Cameron R (2015) History and emergent practices of multimethods and mixed methods in business research. The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (Oxford University Press, Oxford, UK), 466–485.Google Scholar
  • Morse JM (2003) Principles of mixed methods and multimethod research design. Tashakkori A, Teddlie C, eds. Handbook of Mixed Methods in Social & Behavioral Research. 1st ed. (Sage, London), 189–208.Google Scholar
  • Mousavi R, Gu B (2024) Resilience messaging: The effect of governors’ social media communications on community compliance during a public health crisis. Inform. Systems Res. 35(2):505–527.LinkGoogle Scholar
  • Nambisan S, George G (2024) Digital approaches to societal grand challenges: Toward a broader research agenda on managing global-local design tensions. Inform. Systems Res. 35(4):2059–2076.LinkGoogle Scholar
  • Nastasi BK, Hitchcock JH, Brown LM (2010) An inclusive framework for conceptualizing mixed methods design typologies: Moving toward fully integrated synergistic research models. Tashakkori A, Teddlie C, eds. Handbook of Mixed Methods in Social and Behavioral Research. 2nd ed. (SAGE Publications, Los Angeles), 305–338.CrossrefGoogle Scholar
  • Nunamaker JF Jr, Briggs RO, Derrick DC, Schwabe G (2015) The last research mile: Achieving both rigor and relevance in information systems research. J. Management Inform. Systems 32(3):10–47.CrossrefGoogle Scholar
  • Orton JD, Weick KE (1990) Loosely coupled systems: A reconceptualization. Acad. Management Rev. 15(2):203–223.CrossrefGoogle Scholar
  • Padmanabhan B, Fang X, Sahoo N, Burton-Jones A (2022) Machine learning in information systems research. MIS Quart. 46(1):iii–xix.CrossrefGoogle Scholar
  • Pang MS, Kankanhalli A, Aanestad M, Ram S, Maruping LM (2024) Digital technologies and the advancement of social justice: A framework and agenda. MIS Quart. 48(4):1591–1610.CrossrefGoogle Scholar
  • Polyviou A, Pouloudi N, Pramatari K, Silva LO (2024) A DNA helix analogy for interdependent mixed methods research: Enabling cross-fertilizations and interim meta-inferences. J. Assoc. Inform. Systems 25(6):1585–1627.Google Scholar
  • Qiao M, Huang KW (2021) Correcting misclassification bias in regression models with variables generated via data mining. Inform. Systems Res. 32(2):462–480.LinkGoogle Scholar
  • Qiu L, Chhikara A, Vakharia A (2021) Multidimensional observational learning in social networks: Theory and experimental evidence. Inform. Systems Res. 32(3):876–894.LinkGoogle Scholar
  • Rai A (2019) Engaged scholarship: Research with practice for impact. MIS Quart. 43(2):iii–viii.Google Scholar
  • Rossi S, Rossi M, Mukkamala RR, Thatcher JB, Dwivedi YK (2024) Augmenting research methods with foundation models and generative AI. Internat. J. Inform. Management 77:102749.CrossrefGoogle Scholar
  • Sahaym A, Vithayathil J, Sarker S, Sarker S, Bjørn-Andersen N (2023) Value destruction in information technology ecosystems: A mixed-method investigation with interpretive case study and analytical modeling. Inform. Systems Res. 34(2):508–531.LinkGoogle Scholar
  • Salvador F (2007) Toward a product system modularity construct: Literature review and reconceptualization. IEEE Trans. Engrg. Management 54(2):219–240.CrossrefGoogle Scholar
  • Sanchez R, Mahoney JT (1996) Modularity, flexibility, and knowledge management in product and organization design. Strategic Management J. 17(S2):63–76.CrossrefGoogle Scholar
  • Sarker S, Lee AS (2006) Does the use of computer-based BPC tools contribute to redesign effectiveness? Insights from a hermeneutic study. IEEE Trans. Engrg. Management 53(1):130–145.CrossrefGoogle Scholar
  • Sarker S, Ahuja M, Sarker S (2018) Work–life conflict of globally distributed software development personnel: An empirical investigation using border theory. Inform. Systems Res. 29(1):103–126.LinkGoogle Scholar
  • Schwandt T, Lichty LF (2015) What problem are we trying to solve? Practical and innovative uses of multimethod and mixed methods research. Hesse-Biber SN, Johnson RB, eds. Oxford Handbook of Mixed and Multimethod Research (Oxford Press, Oxford, UK).Google Scholar
  • Sein M, Henfridsson O, Purao S, Rossi M, Lindgren R (2011) Action design research. MIS Quart. 35(1):37–56.CrossrefGoogle Scholar
  • Shmueli G (2010) To explain or to predict? Statist. Sci. 25(3):289–310.CrossrefGoogle Scholar
  • Small ML (2011) How to conduct a mixed methods study: Recent trends in a rapidly growing literature. Annual Rev. Sociol. 37(1):57–86.CrossrefGoogle Scholar
  • Tarafdar M, Shan G, Thatcher J, Gupta A (2022) Intellectual diversity in IS research: Discipline-based conceptualization and an illustration from information systems research. Inform. Systems Res. 33(4):1490–1510.LinkGoogle Scholar
  • Tashakkori A, Teddlie C (1998) Mixed Methodology: Combining Qualitative and Quantitative Approaches (SAGE Publications, Thousand Oaks, CA).Google Scholar
  • Tashakkori A, Johnson RB, Teddlie C (2020) Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences (Sage Publications, Thousand Oaks, CA).Google Scholar
  • Teddlie C, Tashakkori A (2009) Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences (Sage Publications, Los Angeles).Google Scholar
  • Te’eni D, Yahav I, Zagalsky A, Schwartz D, Silverman G, Cohen D, Mann Y, Lewinsky D (2023) Reciprocal human-machine learning: A theory and an instantiation for the case of message classification. Management Sci., ePub ahead of print November 14, https://doi.org/10.1287/mnsc.2022.03518.LinkGoogle Scholar
  • Vance A, Jenkins JL, Anderson BB, Bjornn DK, Kirwan CB (2018) Tuning out security warnings: A longitudinal examination of habituation through fMRI, eye tracking, and field experiments. MIS Quart. 42(2):355–380.CrossrefGoogle Scholar
  • Van de Ven AH (2007) Engaged Scholarship: A Guide for Organizational and Social Research (Oxford University Press, Oxford, UK).CrossrefGoogle Scholar
  • Venkatesh V (2025) Leveraging context: Re-thinking research processes to make “contributions to theory.” Inform. Systems Res., ePub ahead of print March 12, https://doi.org/10.1287/isre.2021.0048.LinkGoogle Scholar
  • Venkatesh V, Bala H, Sambamurthy V (2016a) Implementation of an information and communication technology in a developing country: A multimethod longitudinal study in a bank in India. Inform. Systems Res. 27(3):558–579.LinkGoogle Scholar
  • Venkatesh V, Brown S, Bala H (2013) Bridging the qualitative–quantitative divide: Guidelines for conducting mixed methods research in information systems. MIS Quart. 37(1):21–54.CrossrefGoogle Scholar
  • Venkatesh V, Brown S, Sullivan Y (2023) Conducting Mixed Methods Research: From Classical Social Sciences to the Age of Big Data and Analytics (Virginia Tech Libraries, Blacksburg, VA).Google Scholar
  • Venkatesh V, Brown SA, Sullivan YW (2016b) Guidelines for conducting mixed-methods research: An extension and illustration. J. Assoc. Inform. Systems 17(7):435–495.Google Scholar
  • Walsham G (1995) Interpretive case studies in IS research: Nature and method. Eur. J. Inform. Systems 4(2):74–81.CrossrefGoogle Scholar
  • Wellman N, Tröster C, Grimes M, Roberson Q, Rink F, Gruber M (2023) Publishing multimethod research in AMJ: A review and best-practice recommendations. Acad. Management J. 66(4):1007–1015.CrossrefGoogle Scholar
  • Wu J, Zheng Z, Zhao JL (2021) FairPlay: Detecting and deterring online customer misbehavior. Inform. Systems Res. 32(4):1323–1346.LinkGoogle Scholar
  • Yang M, Adomavicius G, Burtch G, Ren Y (2018) Mind the gap: Accounting for measurement error and misclassification in variables generated via data mining. Inform. Systems Res. 29(1):4–24.LinkGoogle Scholar
  • Yin RK (2014) Case Study Research Design and Methods, 5th ed. (Sage, Thousand Oaks, CA).Google Scholar
  • Yu S, Chai Y, Samtani S, Liu H, Chen H (2024) Motion sensor–based fall prevention for senior care: A hidden Markov model with generative adversarial network approach. Inform. Systems Res. 35(1):1–15.LinkGoogle Scholar
  • Zachariadis M, Scott S, Barrett M (2013) Methodological implications of critical realism for mixed methods research. MIS Quart. 37(3):855–879.CrossrefGoogle Scholar
  • Zhang X, Ferreira P, Godinho de Matos M, Belo R (2021) Welfare properties of profit maximizing recommender systems: Theory and results from a randomized experiment. MIS Quart. 45(1):1–43.CrossrefGoogle Scholar
  • Zhao X, Xue L, Song P, Karahanna E (2024) Direct communication and two-sided matching quality on a digital platform: A perspective of choice based on consideration set. Inform. Systems Res. 35(2):629–641.LinkGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.