Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach
Published Online:8 Oct 2020https://doi.org/10.1287/mnsc.2020.3727
References
- (2013a) Beyond rating prediction accuracy: On new perspectives in recommender systems. Proc. 7th ACM Conf. Recommender Systems (Association for Computing Machinery, New York), 459–462.Google Scholar
- (2013b) What makes a great MOOC? An interdisciplinary analysis of student retention in online courses. Internat. Conf. Inform. Systems (AIS, Atlanta).Google Scholar
- (2014) On discovering non-obvious recommendations: Using unexpectedness and neighborhood selection methods in collaborative filtering systems. Proc. 7th ACM Internat. Conf. Web Search Data Mining (Association for Computing Machinery, New York), 655–660.Google Scholar
- (2014) On over-specialization and concentration bias of recommendations: Probabilistic neighborhood selection in collaborative filtering systems. Proc. 8th ACM Conf. Systems (Association for Computing Machinery, New York), 153–160.Google Scholar
- (2015a) The business value of recommendations: A privacy-preserving econometric analysis. Internat. Conf. Inform. Systems (AIS, Atlanta).Google Scholar
- (2015b) On unexpectedness in recommender systems: Or how to better expect the unexpected. ACM Trans. Intelligent Systems Tech. 5(4):1–32.Crossref, Google Scholar
- (2015) Measuring the concentration reinforcement bias of recommender systems. 9th ACM Conf. Recommender Systems (Association for Computing Machinery, New York).Google Scholar
- (2005) Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. Trans. Knowledge Data Engrg. 17(6):734–749.Crossref, Google Scholar
- (2013) Industry or academia, basic or applied? Career choices and earnings trajectories of scientists. Management Sci. 59(4):950–970.Link, Google Scholar
- (1994) Fast algorithms for mining association rules. Proc. 20th Internat. Conf. Very Large Data Bases (Morgan Kaufmann Publishers, Burlington, MA), 487–499.Google Scholar
- (2015) Digitization and the contract labor market. Economic Analysis of the Digital Economy, 219.Google Scholar
- (1970) The market for “lemons”: Quality uncertainty and the market mechanism. Quart. J. Econom. 84(3):488–500.Crossref, Google Scholar
- (2012) Large-scale service marketplaces: The role of the moderating firm. Management Sci. 58(10):1854–1872.Link, Google Scholar
- (2007) Proximity and information technology outsourcing: How local are it services markets? J. Management Inform. Systems 24(2):73–102.Crossref, Google Scholar
- (2001) Wiring the labor market. J. Econom. Perspect. 15(1):25–40.Crossref, Google Scholar
- (1998) Computing inequality: Have computers changed the labor market? Quart. J. Econ. 113(4):1169–1213.Crossref, Google Scholar
- (1997) Fab: Content-based, collaborative recommendation. Commun. ACM 40(3):66–72.Crossref, Google Scholar
- (2008) Importance of measures of past performance: Empirical evidence on quality of e-service providers. Contemporary Accounting Res. 25(2):307–337.Crossref, Google Scholar
- (1962) Investment in human capital: A theoretical analysis. J. Political Econom. 70(5):9–49.Crossref, Google Scholar
- (1994) Human capital revisited. Human Capital: A Theoretical and Empirical Analysis with Special Reference to Education , 3rd ed. (University of Chicago Press, Chicago), 15–28.Google Scholar
- (2007) The Netflix prize. Proc. Internat. Conf. Knowledge Discovery Data Mining Cup Workshop (Association for Computing Machinery, New York), 35.Google Scholar
- (2012) Evaluating online labor markets for experimental research: Amazon.com’s Mechanical Turk. Political Anal. 20(3):351–368.Crossref, Google Scholar
- (2011) Online friend recommendation through personality matching and collaborative filtering. Internat. Conf. Mobile Ubiquitous Comput. Systems Services Tech. (IARIA, Wilmington, DE),230–235.Google Scholar
- (1998) Learning collaborative information filters. Shavlik JW, ed. Proc. 15th Internat. Conf. Machine Learn. (Morgan Kaufmann, Burlington, MA), 46–54.Google Scholar
- (1999) Human capital investment: The returns from education and training to the individual, the firm and the economy. Fiscal Stud. 20(1):1–23.Crossref, Google Scholar
- (2004) The value of human and social capital investments for the business performance of startups. Small Bus. Econom. 23(3):227–236.Crossref, Google Scholar
- (1998) Empirical analysis of predictive algorithms for collaborative filtering. Proc. 14th Conf. Uncertainty Artificial Intelligence (Morgan Kaufmann Publishers, Burlington, MA), 43–52.Google Scholar
- (2018) Upwork’s SVP of marketing explains what it takes to perfect an offering that relies on people. Accessed April 28, 2019, https://www.prnewswire.com/news-releases/snagajob-appoints-former-upwork-ceo-to-board-of-directors-300417689.html.Google Scholar
- (2000) Frictionless commerce? A comparison of Internet and conventional retailers. Management Sci. 46(4):563–585.Link, Google Scholar
- (2011) Goodbye pareto principle, hello long tail: The effect of search costs on the concentration of product sales. Management Sci. 57(8):1373–1386.Link, Google Scholar
- (2016) Are online labor markets spot markets for tasks? A field experiment on the behavioral response to wage cuts. Inform. Systems Res. 27(2):403–423.Link, Google Scholar
- (1999) Combining content-based and collaborative filters in an online newspaper. Proc. ACM SIGIR Workshop Recommender Systems (Association for Computing Machinery, New York).Google Scholar
- (1988) Entrepreneurs’ perceived chances for success. J. Bus. Venturing 3(2):97–108.Crossref, Google Scholar
- (2016) Algorithmic transparency via quantitative input influence: Theory and experiments with learning systems. Sympos. Security Privacy (IEEE, Piscataway, NJ),598–617.Google Scholar
- (1999) Memory-based weighted majority prediction. Special Interest Group Inform. Retrieval Workshop Recommender Systems (Association for Computing Machinery, New York).Google Scholar
- (2010) Design and analysis of contracts for software outsourcing. Inform. Systems Res. 21(1):93–114.Link, Google Scholar
- (1977) Knowing with certainty: The appropriateness of extreme confidence. J. Experiment. Psych. Human Perceptions Performance 3(4):552–564.Crossref, Google Scholar
- (2009) Blockbuster culture’s next rise or fall: The impact of recommender systems on sales diversity. Management Sci. 55(5):697–712.Link, Google Scholar
- Freelancers Union, Upwork (2017) Freelancing in America. Accessed December 2, 2019, https://s3-us-west-1.amazonaws.com/adquiro-content-prod/documents/Infographic_UP-URL_2040x1180.pdf.Google Scholar
- (2014) Counseling for career decision-making difficulties: Measures and methods. Career Development Quart. 62(2):98–113.Crossref, Google Scholar
- (2008) Is the world really flat? A look at offshoring at an online programming marketplace. Management Inform. Systems Quart. 32(2):367–384.Crossref, Google Scholar
- (1999) Using probabilistic relational models for collaborative filtering. Workshop Web Usage Anal. User Profiling (Springer, Verlag, Berlin Heidelberg).Google Scholar
- (1992) Public vs. private investment in human capital: endogenous growth and income inequality. J. Political Econom. 100(4):818–834.Crossref, Google Scholar
- (2016) The Netflix recommender system: Algorithms, business value, and innovation. Trans. Management Inform. Systems 6(4):1–19.Google Scholar
- , (2003) Contracts in offshore software development: An empirical analysis. Management Sci. 49(12):1671–1683.Link, Google Scholar
- (2010) Online labor markets. Saberi A, ed. Internet and Network Economics, Lecture Notes in Computer Science, vol. 6484 (Springer, Berlin, Heidelberg), 515–522.Google Scholar
- (2010) The labor economics of paid crowdsourcing. Conf. Electronic Commerce (Association for Computing Machinery, New York), 209–218.Google Scholar
- (2011) The online laboratory: Conducting experiments in a real labor market. Experiment. Econom. 14(3):399–425.Crossref, Google Scholar
- (2016) Reinforcement learning explained. Accessed December 30, 2018, https://www.oreilly.com/ideas/reinforcement-learning-explained.Google Scholar
- (2011) Robust Statistics (Springer, Berlin, Heidelberg).Google Scholar
- Institute of Business Value (2019) The enterprise guide to closing the skills gap. Accessed December 2, 2019, https://www.ibm.com/downloads/cas/EPYMNBJA.Google Scholar
- (2013) Badges and the Lake Wobegon effect. Accessed December 30, https://www.behind-the-enemy-lines.com/2013/10/badges-and-lake-wobegon-effect.html.Google Scholar
- (2010) Quality management on Amazon Mechanical Turk. Workshop Human Comput. (Association for Computing Machinery, New York), 64–67.Google Scholar
- (2018) Call for papers–special issue of information systems research–humans, algorithms, and augmented intelligence: The future of work, organizations, and society. Inform. Systems Res. 29(1):250–251.Link, Google Scholar
- (2011) The evolution of overconfidence. Nature 477(7364):317–320.Google Scholar
- (1970) Returns from investment in human capital. Amer. Econom. Rev. 60(4):546–560.Google Scholar
- (2011) Recommender Systems Handbook (Springer, New York).Google Scholar
- (2019) Totalvardist: Generic function for the computation of the total variation distance of two distributions. Accessed December 2, 2019, https://www.rdocumentation.org/packages/distrEx/versions/2.5/topics/TotalVarDist.Google Scholar
- (2018) Dynamic recommendations for sequential hiring decisions in online labor markets. Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 453–461.Google Scholar
- (2019) Reputation deflation through dynamic expertise assessment in online labor markets. World Wide Web Conf. (ACM), 896–905.Google Scholar
- (2020) Skillset Diversification in Online Labor Markets: Reputation Losses and Opportunity Gains. Working paper, Boston College, Boston.Google Scholar
- (2013) Have you done anything like that? Predicting performance using inter-category reputation. Internat. Conf. Web Search Data Mining (ACM, New York), 435–444.Google Scholar
- (2014) The utility of skills in online labor markets. Internat. Conf. Inform. Systems (Association for Information Systems, Atlanta).Google Scholar
- (2016) Reputation transferability in online labor markets. Management Sci. 62(6):1687–1706.Link, Google Scholar
- (2020) The good, the bad, and the unhirable: Recommending job applicants in online labor markets. Working paper Boston College, Boston.Google Scholar
- (2015) Hiring behavior models for online labor markets. Proc. Eighth ACM Internat. Conf. Web Search Data Mining (Association for Computing Machinery, New York), 223–232.Google Scholar
- (2004) Internet job search and unemployment durations. Amer. Econom. Rev. 94(1):218–232.Crossref, Google Scholar
- (2008) Addressing cold-start problem in recommendation systems. Proc. 2nd Internat. Conf. Ubiquitous Inform. Management Comm. (ACM, New York),208–211.Google Scholar
- (1995) Newsweeder: Learning to filter netnews. Prieditis A, Russell S, eds. Internat. Machine Learn. Conf. (Morgan Kaufmann, Burlington, MA), 331–339.Google Scholar
- (2017) Snagajob appoints former Upwork CEO to board of directors. Accessed April 28, 2019, https://www.prnewswire.com/news-releases/snagajob-appoints-former-upwork-ceo-to-board-of-directors-300417689.html.Google Scholar
- (2009) Firm-specific human capital: A skill-weights approach. J. Political Econom. 117(5):914–940.Crossref, Google Scholar
- (2008) Effects of using a portable navigation system and paper map in real driving. Accident Anal. Prevention 40(1):303–308.Crossref, Google Scholar
- (2005) Slope one predictors for online rating-based collaborative filtering. Internat. Conf. Data Mining (SIAM, Philadelphia), 471–475.Google Scholar
- (1999) The human resource architecture: Toward a theory of human capital allocation and development. Acad. Management Rev. 24(1):31–48.Crossref, Google Scholar
- (2016) Effects of IT-enabled monitoring systems in online labor markets. Internat. Conf. Inform. Systems (AIS, Atlanta).Google Scholar
- (2016) Effectiveness of reputation in contracting for customized production: Evidence from online labor markets. Management Sci. 64(1):345–359.Link, Google Scholar
- (2009) Principles of Economics: Unabridged , 8th ed. (Cosimo Inc., New York).Google Scholar
- (2010) Financial incentives and the performance of crowds. SIGKDD Explorations Newsletter 11(2):100–108.Google Scholar
- (2002) Content-boosted collaborative filtering for improved recommendations. 18th National Conf. Artificial Intelligence (ACM, New York), 187–192.Google Scholar
- (2013) Efficient estimation of word representations in vector space. Preprint, submitted January 16, https://arxiv.org/abs/1301.3781.Google Scholar
- (2000) Content-based book recommending using learning for text categorization. Conf.Digital Libraries (ACM, New York), 195–204.Google Scholar
- (2014) Doing business with strangers: Reputation in online service marketplaces. Inform. Systems Res. 25(4):865–886.Link, Google Scholar
- (2017) Collaborative filtering: Techniques and applications. Internat. Conf. Comm. Control Comput. Electronics Engrg. (IEEE, Piscataway, NJ), 1–6.Google Scholar
- (2011) Psychology in Everyday Life (Macmillan, New York).Google Scholar
- (1998) Volume, volatility, price, and profit when all traders are above average. J. Finance 53(6):1887–1934.Crossref, Google Scholar
- (2015) Redefining graduate employability and work-integrated learning: Proposals for effective higher education in disrupted economies. J. Teaching Learn. Graduate Employability 6(1):56–65.Crossref, Google Scholar
- (2010) Empirical analysis of the impact of recommender systems on sales. J. Management Inform. Systems 27(2):159–188.Crossref, Google Scholar
- (1997) Learning and revising user profiles: The identification of interesting web sites. Machine Learn. 27(3):313–331.Crossref, Google Scholar
- (1999) A framework for collaborative, content-based and demographic filtering. Artificial Intelligence Rev. 13(5-6):393–408.Crossref, Google Scholar
- (2009) Using Twitter to recommend real-time topical news. Proc. Third ACM Conf. Recommender Systems (ACM, New York), 385–388.Google Scholar
- (2018) Explanations as mechanisms for supporting algorithmic transparency. Proc. Conf. Human Factors Comput. Systems (ACM, New York), 1–13.Google Scholar
- (2012) The promise of mechanical turk: How online labor markets can help theorists run behavioral experiments. J. Theoret. Biol. 299:172–179.Crossref, Google Scholar
- (2011) Introduction to recommender systems handbook. Recommender Systems Handbook (Springer, New York), 1–35.Google Scholar
- (1983) Specialization and human capital. J. Labor Econom. 1(1):43–49.Crossref, Google Scholar
- (2012) A hidden Markov model for collaborative filtering. Management Inform. Systems Quart. 36(4):1329–1356.Crossref, Google Scholar
- (1999) Recommender systems in e-commerce. Proc. 1st ACM Conf. Electronic Commerce (ACM, New York), 158–166.Google Scholar
- (2018) Upwork press release. Accessed April 28, 2019, https://www.upwork.com/press/2018/05/01/q1-2018-skills-index/.Google Scholar
- (1961) Investment in human capital. Amer. Econom. Rev. 51(1):1–17.Google Scholar
- (2008) Get another label? Improving data quality and data mining using multiple, noisy labelers. Internat. Conf. Knowledge Discovery Data Mining (ACM, New York),614–622.Google Scholar
- (2003) Flexible mixture model for collaborative filtering. Proc. 20th Internat. Conf. Machine Learn. (AAAI, Palo Alto, CA), 704–711.Google Scholar
- (1999) Diagnosing the search cost effect: Waiting time and the moderating impact of prior category knowledge. J. Econom. Psych. 20(3):285–314.Crossref, Google Scholar
- (2009) The internet and job search. Autor DH, ed. Studies of Labor Market Intermediation (University of Chicago Press, Chicago), 67–86.Google Scholar
- (2016) The Sharing Economy: The End of Employment and the Rise of Crowd-Based Capitalism (MIT Press, Cambridge, MA).Google Scholar
- (1998) Reinforcement Learning: An Introduction (MIT Press, Cambridge).Google Scholar
- (2008) Separating fact from fiction: An examination of deceptive self-presentation in online dating profiles. Perspect. Soc. Psych. Bull. 34(8):1023–1036.Crossref, Google Scholar
- (2008) Tag-aware recommender systems by fusion of collaborative filtering algorithms. Proc. 2008 ACM Sympos. Appl. Comput. (Association for Computing Machinery, New York), 1995–1999.Google Scholar
- Upwork (2014) Online work report. Accessed April 28, 2019, https://web.archive.org/web/20180228011632/http://elance-odesk.com:80/online-work-report-global.Google Scholar
- Upwork Enterprise (2017) Quarterly trends report. Accessed April 28, 2019, https://www.upwork.com/s/enterprise-trends/.Google Scholar
- (1992) Q-learning. Machine Learn. 8(3-4):279–292.Google Scholar
- (2009) Prediction and control under uncertainty: Outcomes in angel investing. J. Bus. Venturing 24(2):116–133.Crossref, Google Scholar
- (2013) The value of reputation in an online freelance marketplace. Marketing Sci. 32(6):860–891.Link, Google Scholar

