Learning to Successfully Hire in Online Labor Markets

Published Online:https://doi.org/10.1287/mnsc.2022.4426

References

  • Agile-1 (2016) Gig economy. Accessed November 28, 2020, http://www.hrotoday.com/wp-content/uploads/2016/07/Whitepaper_Agile2016-single.pdf.Google Scholar
  • Agrawal A, Horton JJ, Lacetera N, Lyons E (2015) Digitization and the contract labor market. Goldfarb A, Greenstein SM, Tucker CE, eds. Economic Analysis of the Digital Economy (University of Chicago Press, Chicago), 219–250.CrossrefGoogle Scholar
  • Allon G, Bassamboo A, Çil EB (2012) Large-scale service marketplaces: The role of the moderating firm. Management Sci. 58(10):1854–1872.LinkGoogle Scholar
  • Arora A, Forman C (2007) Proximity and information technology outsourcing: How local are IT services markets? J. Management Inform. Systems 24(2):73–102.CrossrefGoogle Scholar
  • Barr PS, Stimpert JL, Huff AS (1992) Cognitive change, strategic action, and organizational renewal. Strategic Management J. 13(S1):15–36.CrossrefGoogle Scholar
  • Brier E, Pearson R (2018) Upwork’s SVP of marketing explains what it takes to perfect an offering that relies on people. Accessed November 28, 2020, https://techdayhq.com/community/articles/upwork-s-svp-of-marketing-explains-what-it-takes-to-perfect-an-offering-that-relies-on-people.Google Scholar
  • Broyden CG (1970) The convergence of a class of double-rank minimization algorithms. 1. General considerations. J. Appl. Math. 6(1):76–90.Google Scholar
  • Busenitz LW, Barney JB (1994) Biases and heuristics in strategic decision making: Differences between entrepreneurs and managers in large organizations. Acad. Management Proc. 1994(1):85–89.CrossrefGoogle Scholar
  • Busenitz LW, Barney JB (1997) Differences between entrepreneurs and managers in large organizations: Biases and heuristics in strategic decision-making. J. Bus. Venturing 12(1):9–30.CrossrefGoogle Scholar
  • Caves RE, Greene DP (1996) Brands’ quality levels, prices, and advertising outlays: Empirical evidence on signals and information costs. Internat. J. Indust. Organ. 14(1)29–52.CrossrefGoogle Scholar
  • Chan J, Wang J (2017) Hiring preferences in online labor markets: Evidence of a female hiring bias. Management Sci. 64(7):2973–3468.LinkGoogle Scholar
  • Chen DL, Horton JJ (2016) Are online labor markets spot markets for tasks? A field experiment on the behavioral response to wage cuts. Inform. Systems Res. 27(2):403–423.LinkGoogle Scholar
  • Danescu-Niculescu-Mizil C, Kossinets G, Kleinberg J, Lee L (2009) How opinions are received by online communities: A case study on Amazon.com helpfulness votes. Internat. Conf. World Wide Web (ACM, New York), 141–150.Google Scholar
  • Denrell J, March JG (2001) Adaptation as information restriction: The hot stove effect. Organ. Sci. 12(5):523–538.LinkGoogle Scholar
  • Dequech D (1999) Expectations and confidence under uncertainty. J. Post Keynesian Econom. 21(3):415–430.CrossrefGoogle Scholar
  • Dey D, Fan M, Zhang C (2010) Design and analysis of contracts for software outsourcing. Inform. Systems Res. 21(1):93–114.LinkGoogle Scholar
  • Erdem T, Keane MP, Sun B (2008) A dynamic model of brand choice when price and advertising signal product quality. Marketing Sci. 27(6):1111–1125.LinkGoogle Scholar
  • Erev I, Roth AE (2014) Maximization, learning, and economic behavior. Proc. National Acad. Sci. USA 111(supplement_3):10818–10825.CrossrefGoogle Scholar
  • Evans JJ, Wilson BA, Schuri U, Andrade J, Baddeley A, Bruna O, Canavan T (2000) A comparison of “errorless” and “trial-and-error” learning methods for teaching individuals with acquired memory deficits. Neuropsychological Rehabilitation 10(1):67–101.CrossrefGoogle Scholar
  • Filippas A, Horton JJ, Golden J (2018) Reputation inflation. Conf. Econom. Comput. (ACM, New York), 483–484.Google Scholar
  • Forlani D, Mullins JW (2000) Perceived risks and choices in entrepreneurs’ new venture decisions. J. Bus. Venturing 15(4):305–322.CrossrefGoogle Scholar
  • Gefen D, Carmel E (2008) Is the world really flat? A look at offshoring at an online programming marketplace. MIS Quart. 32(2):367–384.CrossrefGoogle Scholar
  • Gefen D, Gefen G, Carmel E (2016) How project description length and expected duration affect bidding and project success in crowdsourcing software development. J. Systems Software 116:75–84.CrossrefGoogle Scholar
  • Gerstner E (1985) Do higher prices signal higher quality? J. Marketing Res. 22(2):209–215.CrossrefGoogle Scholar
  • Geva T, Saar-Tsechansky M (2016) Who’s a good decision maker? Data-driven expert worker ranking under unobservable quality. Internat. Conf. Inform. Systems (Association for Information Systems, Atlanta), 1–16.Google Scholar
  • Ghani E, Kerr WR, Stanton C (2014) Diasporas and outsourcing: Evidence from oDesk and India. Management Sci. 60(7):1677–1697.LinkGoogle Scholar
  • Gibson CB, Birkinshaw J (2004) The antecedents, consequences, and mediating role of organizational ambidexterity. Acad. Management J. 47(2):209–226.CrossrefGoogle Scholar
  • Goes P, Lin M (2013) Does information really “unravel” understanding factors that motivate sellers to seek third-party certifications in an online labor market. Working paper, Tulane University, New Orleans.Google Scholar
  • Goes PB, Lin M, Ching-man AY (2014) “Popularity effect” in user-generated content: Evidence from online product reviews. Inform. Systems Res. 25(2):222–238.LinkGoogle Scholar
  • Good D, Michel EJ (2013) Individual ambidexterity: Exploring and exploiting in dynamic contexts. J. Psych. 147(5):435–453.CrossrefGoogle Scholar
  • Goodman-Delahunty J, Granhag PA, Hartwig M, Loftus EF (2010) Insightful or wishful: Lawyers’ ability to predict case outcomes. Psych. Public Policy Law 16(2):133–157.CrossrefGoogle Scholar
  • Gopal A, Sivaramakrishnan K, Krishnan MS, Mukhopadhyay T(2003) Contracts in offshore software development: An empirical analysis. Management Sci. 49(12):1671–1683.LinkGoogle Scholar
  • Grewal D, Gotlieb J, Marmorstein H (1994) The moderating effects of message framing and source credibility on the price-perceived risk relationship. J. Consumer Res. 21(1):145–153.CrossrefGoogle Scholar
  • Grinold R, Kahn R (2000) Active Portfolio Management (McGraw Hill, New York).Google Scholar
  • Guadagni PM, Little JDC (1983) A logit model of brand choice calibrated on scanner data. Marketing Sci. 2(3):203–238.LinkGoogle Scholar
  • Heckman JJ (1979) Sample selection bias as a specification error. Econometrica 47(1):153–161.CrossrefGoogle Scholar
  • Holmqvist M (2004) Experiential learning processes of exploitation and exploration within and between organizations: An empirical study of product development. Organ. Sci. 15(1):70–81.LinkGoogle Scholar
  • Hong Y, Pavlou PA (2017) On buyer selection of service providers in online outsourcing platforms for IT services. Inform. Systems Res. 28(3):547–562.LinkGoogle Scholar
  • Hong Y, Wang C, Pavlou PA (2015) Comparing open and sealed bid auctions: Evidence from online labor markets. Inform. Systems Res. 27(1):49–69.LinkGoogle Scholar
  • Hong Y, Huang N, Burtch G, Li C (2016) Culture, conformity, and emotional suppression in online reviews. J. Assoc. Inform. Systems 17(11). https://aisel.aisnet.org/jais/vol17/iss11/2/#:~:text=We%20found%20that%20consumers%20from,emotions%20to%20be%20less%20helpful.Google Scholar
  • Horton JJ (2010) Online labor markets. Saberi A, ed. Internet and Network Economics, Lecture Notes in Computer Science, vol. 6484 (Springer, Berlin Heidelberg).CrossrefGoogle Scholar
  • Horton JJ, Chilton LB (2010) The labor economics of paid crowdsourcing. Proc. 11th ACM Conf. Electronic Commerce (ACM, New York), 209–218.Google Scholar
  • Hull CL (1930) Simple trial and error learning: A study in psychological theory. Psych. Rev. 37(3):241–256.CrossrefGoogle Scholar
  • Ipeirotis PG, Provost F, Wang J (2010) Quality management on Amazon Mechanical Turk. Proc. ACM SIGKDD Workshop Human Comput. (ACM, New York), 64–67.Google Scholar
  • Jain H, Padmanabhan B, Pavlou PA, Santanam RT (2018) Call for papers—Special issue of Information Systems Research—Humans, algorithms, and augmented intelligence: The future of work, organizations, and society. Inform. Systems Res. 29(1):250–251.LinkGoogle Scholar
  • Jerath K, Fader PS, Hardie GSB (2011) New perspectives on customer “death” using a generalization of the Pareto/NBD model. Marketing Sci. 30(5):866–880.LinkGoogle Scholar
  • Jueptner M, Frith CD, Brooks DJ, Frackowiak R, Passingham R(1997) Anatomy of motor learning. II. Subcortical structures and learning by trial and error. J. Neurophysiology 77(3):1325–1337.CrossrefGoogle Scholar
  • Kahneman D, Lovallo D (1993) Timid choices and bold forecasts: A cognitive perspective on risk taking. Management Sci. 39(1):17–31.LinkGoogle Scholar
  • Kokkodis M (2018) Dynamic recommendations for sequential hiring decisions in online labor markets. Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 453–461.Google Scholar
  • Kokkodis M (2021) Dynamic, multi-dimensional, and skillset-specific reputation systems for online work. Inform. Systems Res. 32(3):688–712.LinkGoogle Scholar
  • Kokkodis M, Ipeirotis PG (2014) The utility of skills in online labor markets. Internat. Conf. Inform. Systems. https://aisel.aisnet.org/icis2014/proceedings/DecisionAnalytics/15/.Google Scholar
  • Kokkodis M, Ipeirotis PG (2016) Reputation transferability in online labor markets. Management Sci. 62(6):1687–1706.LinkGoogle Scholar
  • Kokkodis M, Papadimitriou P, Ipeirotis PG (2015) Hiring behavior models for online labor markets. Proc. Eighth ACM Internat. Conf. Web Search Data Mining (ACM, New York), 223–232.Google Scholar
  • Kossinets G, Watts DJ (2009) Origins of homophily in an evolving social network. Amer. J. Sociol. 115(2):405–450.CrossrefGoogle Scholar
  • Kreye ME, Yee MG, Newnes LB, Goodwin P (2012) Approaches to displaying information to assist decisions under uncertainty. Omega 40(6):682–692.CrossrefGoogle Scholar
  • Lauren D (2017) Snagajob appoints former Upwork CEO to board of directors. Accessed November 28, 2020, https://www.prnewswire.com/news-releases/snagajob-appoints-former-upwork-ceo-to-board-of-directors-300417689.html.Google Scholar
  • Lee S (2019) Learning-by-moving: Can reconfiguring spatial proximity between organizational members promote individual-level exploration? Organ. Sci. 30(3):467–488.LinkGoogle Scholar
  • Lee S, Meyer-Doyle P (2017) How performance incentives shape individual exploration and exploitation: Evidence from microdata. Organ. Sci. 28(1):19–38.LinkGoogle Scholar
  • Levinthal DA, March JG (1993) The myopia of learning. Strategic Management J. 14(S2):95–112.CrossrefGoogle Scholar
  • Liang C, Hong Y, Gu B (2017) Moral hazards and effects of IT-enabled monitoring systems in online labor markets. Internat. Conf. Inform. Systems (Association for Information Systems, Atlanta), 1–10.Google Scholar
  • Lin M, Viswanathan S (2015) Home bias in online investments: An empirical study of an online crowdfunding market. Management Sci. 62(5):1393–1414.LinkGoogle Scholar
  • Lin M, Liu Y, Viswanathan S (2016) Effectiveness of reputation in contracting for customized production: Evidence from online labor markets. Management Sci. 64(1):345–359.LinkGoogle Scholar
  • Liu Y, Huang X, An A, Yu X (2008) Modeling and predicting the helpfulness of online reviews. Giannotti F, Gunopulos D, Turini F, Zaniolo C, Ramakrishnan, Wu X, eds. IEEE Internat. Conf. Data Mining (IEEE, Piscataway, NJ), 443–452.Google Scholar
  • LIWC (2018) Linguistic inquiry and word count. Accessed November 28, 2020. http://liwc.wpengine.com/.Google Scholar
  • Lu Y, Tsaparas P, Ntoulas A, Polanyi L (2010) Exploiting social context for review quality prediction. Proc. 19th Internat. Conf. World Wide Web (ACM, New York), 691–700.Google Scholar
  • March JG (1991) Exploration and exploitation in organizational learning. Organ. Sci. 2(1):71–87.LinkGoogle Scholar
  • Mason W, Watts DJ (2010) Financial incentives and the performance of crowds. ACM SIGKDD Explorations Newsletter 11(2):100–108.Google Scholar
  • McFadden D (1973) Conditional logit analysis of qualitative choice behavior. Zarembka P, ed. Frontiers in Econometrics (Academic Press, New York), 105–142.Google Scholar
  • Menkhoff L, Schmidt U, Brozynski T (2006) The impact of experience on risk taking, overconfidence, and herding of fund managers: Complementary survey evidence. Eur. Econom. Rev. 50(7):1753–1766.CrossrefGoogle Scholar
  • Mom TJM, Van Den Bosch FAJ, Volberda HW (2007) Investigating managers’ exploration and exploitation activities: The influence of top-down, bottom-up, and horizontal knowledge inflows. J. Management Stud. 44(6):910–931.CrossrefGoogle Scholar
  • Mom TJM, Van Den Bosch FAJ, Volberda HW (2009) Understanding variation in managers’ ambidexterity: Investigating direct and interaction effects of formal structural and personal coordination mechanisms. Organ. Sci. 20(4):812–828.LinkGoogle Scholar
  • Moreno A, Terwiesch C (2014) Doing business with strangers: Reputation in online service marketplaces. Inform. Systems Res. 25(4):865–886.LinkGoogle Scholar
  • Nelson P (1970) Information and consumer behavior. J. Political Econom. 78(2):311–329.CrossrefGoogle Scholar
  • Palich LE, Bagby DR (1995) Using cognitive theory to explain entrepreneurial risk-taking: Challenging conventional wisdom. J. Bus. Venturing 10(6):425–438.CrossrefGoogle Scholar
  • Pallais A (2014) Inefficient hiring in entry-level labor markets. Amer. Econom. Rev. 104(11):3565–3599.CrossrefGoogle Scholar
  • Peterson DK, Pitz GF (1988) Confidence, uncertainty, and the use of information. J. Experiment. Psych. Learn. Memory Cognition 14(1):85–92.CrossrefGoogle Scholar
  • Plassmann H, O’Doherty J, Shiv B, Rangel A (2008) Marketing actions can modulate neural representations of experienced pleasantness. Proc. Natl. Acad. Sci. USA 105(3):1050–1054.CrossrefGoogle Scholar
  • Rahman H (2018) Don’t worship the stars: Ratings inflation in online labor markets. Pries-Heje J, Ram S, Rosemann M, eds. Proc. Internat. Conf. Inform. Systems (Association for Information Systems, Atlanta).Google Scholar
  • Rao AR, Monroe KB (1989) The effect of price, brand name, and store name on buyers’ perceptions of product quality: An integrative review. J. Marketing Res. 26(3):351–357.CrossrefGoogle Scholar
  • Robinson AT, Marino LD (2015) Overconfidence and risk perceptions: Do they really matter for venture creation decisions? Internat. Entrepreneurship Management J. 11(1):149–168.CrossrefGoogle Scholar
  • Rogan M, Mors ML (2014) A network perspective on individual-level ambidexterity in organizations. Organ. Sci. 25(6):1860–1877.LinkGoogle Scholar
  • Rosing K, Zacher H (2017) Individual ambidexterity: The duality of exploration and exploitation and its relationship with innovative performance. Eur. J. Work Organ. Psych. 26(5):694–709.CrossrefGoogle Scholar
  • Schilling MA, Vidal P, Ployhart RE, Marangoni A (2003) Learning by doing something else: Variation, relatedness, and the learning curve. Management Sci. 49(1):39–56.LinkGoogle Scholar
  • Sheng VS, Provost F, Ipeirotis PG (2008) Get another label? Improving data quality and data mining using multiple, noisy labelers. Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 614–622.Google Scholar
  • Shiv B, Carmon Z, Ariely D (2005) Placebo effects of marketing actions: Consumers may get what they pay for. J. Marketing Res. 42(4):383–393.CrossrefGoogle Scholar
  • Skinner BF (1990) The Behavior of Organisms: An Experimental Analysis (BF Skinner Foundation, Cambridge, MA).Google Scholar
  • Smith-Keiling BL, Hyun HIF (2019) Applying a computer-assisted tool for semantic analysis of writing: Uses for STEM and ELL. J. Microbiology Biol. Ed. 20(1).Google Scholar
  • Snir EM, Hitt LM (2003) Costly bidding in online markets for IT services. Management Sci. 49(11):1504–1520.LinkGoogle Scholar
  • Snyder CR, Lopez SJ (2009) Oxford Handbook of Positive Psychology, Oxford Library of Psychology (Oxford University Press, Oxford, UK).Google Scholar
  • Sridhar S, Srinivasan R (2012) Social influence effects in online product ratings. J. Marketing 76(5):70–88.CrossrefGoogle Scholar
  • Sundararajan A (2016) The Sharing Economy: The End of Employment and the Rise of Crowd-Based Capitalism (MIT Press, Cambridge, MA).Google Scholar
  • Svveeney LC (1999) The role of perceived risk in the quality-value relationship: A study in a retail environment. J. Retailing 75(1):77–105.CrossrefGoogle Scholar
  • Tripp MT, Grégoire Y (2011) When unhappy customers strike back on the internet. MIT Sloan Management Rev. 52(3):37–44.Google Scholar
  • Wooldridge MJ (2010) Econometric Analysis of Cross Section and Panel Data (MIT Press, Cambridge, MA).Google Scholar
  • Yelle LE (1979) The learning curve: Historical review and comprehensive survey. Decision Sci. 10(2):302–328.CrossrefGoogle Scholar
  • Yin D, Bond S, Zhang H (2014) Anxious or angry? Effects of discrete emotions on the perceived helpfulness of online reviews. MIS Quart. 38(2):539–560.CrossrefGoogle Scholar
  • Yoganarasimhan H (2013) The value of reputation in an online freelance marketplace. Marketing Sci. 32(6):860–891.LinkGoogle Scholar
  • Zheng A, Hong Y, Pavlou PA (2016) Matching in two-sided platforms for IT services: Evidence from online labor markets. Working paper, Temple University, Philadelphia.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.