Dynamic, Multidimensional, and Skillset-Specific Reputation Systems for Online Work

Published Online:https://doi.org/10.1287/isre.2020.0972

References

  • Abhinav K, Dubey A, Jain S, Virdi G, Kass A, Mehta M (2017) Crowdadvisor: A framework for freelancer assessment in online marketplace. IEEE/ACM 39th Internat. Conf. Software Engrg.: Software Engrg. Practice Track (IEEE, New York), 93–102.Google Scholar
  • Adamopoulos P (2013) Beyond rating prediction accuracy: on new perspectives in recommender systems. RecSys ’13: Proc. 7th ACM Conf. Recommender Systems (ACM, New York), 459–462.Google Scholar
  • Adamopoulos P, Tuzhilin A (2013) Recommendation opportunities: improving item prediction using weighted percentile methods in collaborative filtering systems. RecSys ’13: Proc. 7th ACM Conf. Recommender Systems (ACM, New York), 351–354.Google Scholar
  • Adamopoulos P, Tuzhilin A (2014) On over-specialization and concentration bias of recommendations: Probabilistic neighborhood selection in collaborative filtering systems. RecSys ’14: Proc. 8th ACM Conf. Recommender Systems (ACM, New York), 153–160.Google Scholar
  • Adamopoulos P, Tuzhilin A 2015. The business value of recommendations: A privacy-preserving econometric analysis. Proc. 36th Internat. Conf. Inform. Systems (AIS, Atlanta).Google Scholar
  • Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. Trans. Knowledge Data Engrg. 17(6):734–749.CrossrefGoogle Scholar
  • Agile-1 (2016) The new gig economy: What’s at stake? Retrieved December 2, 2019, http://www.hrotoday.com/wp-content/uploads/2016/07/Whitepaper_Agile2016-single.pdf.Google Scholar
  • Agrawal A, Lacetera N, Lyons E (2013) Does information help or hinder job applicants from less developed countries in online markets? NBER Working Paper 18720, National Bureau of Economic Research, Cambridge, MA.Google Scholar
  • Agrawal R, Srikant R (1994) Fast algorithms for mining association rules. Bocca JB, Jarke M, Zaniolo CA, eds. VLDB ’94: Proc. 20th Internat. Conf. Very Large Data Bases (Morgan Kaufmann Publishers, San Francisco), 487–499.Google Scholar
  • Akerlof GA (1970) The market for “lemons”: Quality uncertainty and the market mechanism. Quart. J. Econom. 84(3):488–500.CrossrefGoogle Scholar
  • Allahbakhsh M, Ignjatovic A, Benatallah B, Bertino E, Foo N (2012) Reputation management in crowdsourcing systems. Internat. Conf. Collaborative Comput.: Networking Appl. Worksharing (CollaborateCom) (IEEE, New York), 664–671.Google Scholar
  • Amazon (2018) Customer reviews. Retrieved December 2, 2019, https://www.amazon.com/gp/help/customer/display.html?nodeId=202094910.Google Scholar
  • Amazon (2020) Search by “avg. customer review.” Retrieved May 2, https://www.amazon.com/gp/help/customer/display.html?nodeId=201889520.Google Scholar
  • Autor DH (2001) Wiring the labor market. J. Econom. Perspect. 15(1):25–40.CrossrefGoogle Scholar
  • Autor DH, Katz LF, Krueger AB (1998) Computing inequality: Have computers changed the labor market? Quart. J. Econom. 113(4):1169–1213.CrossrefGoogle Scholar
  • Ba S, Pavlou PA (2002) Evidence of the effect of trust building technology in electronic markets: Price premiums and buyer behavior. MIS Quart. 26(3):243–268.CrossrefGoogle Scholar
  • Baba Y, Kinoshita K, Kashima H (2016) Participation recommendation system for crowdsourcing contests. Expert Systems Appl. 58:174–183.CrossrefGoogle Scholar
  • Bakos Y (1997) Reducing buyer search costs: Implications for electronic marketplaces. Management Sci. 43(12):1676–1692.LinkGoogle Scholar
  • Balog K, De Rijke M (2007) Determining expert profiles (with an application to expert finding). Sangal R, Mehta H, Bagga RK, eds. IJCAI ’07: Proc. 20th Internat. Joint Conference Artificial Intelligence (Morgan Kaufmann Publishers, San Francisco), 2657–2662.Google Scholar
  • Banker RD, Hwang I (2008) Importance of measures of past performance: Empirical evidence on quality of e-service providers. Contemporary Accounting Res. 25(2):307–337.CrossrefGoogle Scholar
  • Billsus D, Pazzani MJ (1998) Learning collaborative information filters. Shavlik JW, ed. ICML ’98: Proc. 15th Internat. Conf. Machine Learn. (Morgan Kaufmann Publishers, San Francisco), 46–54.Google Scholar
  • Bouguessa M, Dumoulin B, Wang S (2008) Identifying authoritative actors in question-answering forums: The case of Yahoo! answers. KDD ’08: Proc. 14th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 866–874.Google Scholar
  • Breese SJ, Heckerman D, Kadie C (1998) Empirical analysis of predictive algorithms for collaborative filtering. Cooper GF, Serafín M, eds. UAI ’98: Proc. 14th Conf. Uncertainty Artificial Intelligence (Morgan Kaufmann Publishers, San Francisco), 43–52.Google Scholar
  • Brynjolfsson E, Mitchell T, Rock D (2018) What can machines learn, and what does it mean for occupations and the economy? AEA Papers Proc. 108:43–47.CrossrefGoogle Scholar
  • Chen T, Guestrin C (2016) XGBoost: A scalable tree boosting system. KDD ’16: Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 785–794.Google Scholar
  • Chevalier JA, Mayzlin D (2006) The effect of word of mouth on sales: Online book reviews. J. Marketing Res. 43(3):345–354.CrossrefGoogle Scholar
  • Christoforaki M, Ipeirotis PG (2015) A system for scalable and reliable technical-skill testing in online labor markets. Comput. Networks 90:110–120.CrossrefGoogle Scholar
  • Cui G, Lui H-K, Guo X (2012) The effect of online consumer reviews on new product sales. Internat. J. Electronic Commerce 17(1):39–58.CrossrefGoogle Scholar
  • Curtis N, Safavi-Naini R, Susilo W (2004) X2Rep: Enhanced trust semantics for the XRep protocol. Jakobsson M, Yung M, Zhou J, eds. Appl. Cryptography Network Security: ACNS 2004 (Springer, Berlin), 205–219.Google Scholar
  • Daltayanni M, de Alfaro L, Papadimitriou P (2015) WorkerRank: Using employer implicit judgements to infer worker reputation. WSDM ’15: Proc. 8th ACM Internat. Conf. Web Search Data Mining (ACM, New York), 263–272.Google Scholar
  • Damiani E, di Vimercati DC, Paraboschi S, Samarati P, Violante F (2002) A reputation-based approach for choosing reliable resources in peer-to-peer networks. CCS ’02: Proc. 9th ACM Conf. Comput. Comm. Security (ACM, New York), 207–216.Google Scholar
  • Delgado J, Ishii N (1999) Memory-based weighted majority prediction. Proc. Special Interest Group Inform. Retrieval Workshop Recommender Systems.Google Scholar
  • Dellarocas C (2003) The digitization of word of mouth: Promise and challenges of online feedback mechanisms. Management Sci. 49(10):1407–1424.LinkGoogle Scholar
  • Dellarocas C (2006) Reputation mechanisms. Handbook on Economics and Information Systems 629–660.Google Scholar
  • Devooght R, Bersini H (2017) Collaborative filtering based on sequences. Retrieved December 2, 2019, https://github.com/rdevooght/sequence-based-recommendations.Google Scholar
  • Duan W, Gu B, Whinston AB (2008) Do online reviews matter? An empirical investigation of panel data. Decision Support Systems 45(4):1007–1016.CrossrefGoogle Scholar
  • eBay (2018) Feedback forum. Retrieved December 2, 2019, https://pages.ebay.com/services/forum/feedback.html.Google Scholar
  • Einav L, Farronato C, Levin J (2016) Peer-to-peer markets. Annual Rev. Econom. 8:615–635.CrossrefGoogle Scholar
  • Filippas A, Horton JJ, Golden J (2018) Reputation inflation. EC ’18: Proc. 2018 ACM Conf. Econom. !Comput. (ACM, New York), 483–484.Google Scholar
  • Freelancers Union (2017) Freelancing in America. Retrieved December 2, 2019, https://www.upwork.com/i/freelancing-in-america/2017/.Google Scholar
  • Gandini A, Pais I, Beraldo D (2016) Reputation and trust on online labour markets: The reputation economy of elance. Work Organ. Labour Globalisation 10(1):27–43.CrossrefGoogle Scholar
  • Ghose A, Ipeirotis PG (2011) Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics. Trans. Knowledge Data Engrg. 23(10):1498–1512.CrossrefGoogle Scholar
  • Ghose A, Ipeirotis PG, Li B (2012) Designing ranking systems for hotels on travel search engines by mining user-generated and crowdsourced content. Marketing Sci. 31(3):493–520.LinkGoogle Scholar
  • Ghose A, Ipeirotis PG, Li B (2014) Examining the impact of ranking on consumer behavior and search engine revenue. Management Sci. 60(7):1632–1654.LinkGoogle Scholar
  • Goswami A, Hedayati F, Mohapatra P (2014) Recommendation systems for markets with two sided preferences. Proc. 13th Internat. Conf. Machine Learn. Appl. (IEEE, New York), 282–287.Google Scholar
  • Graham M, Hjorth I, Lehdonvirta V (2017) Digital labour and development: Impacts of global digital labour platforms and the gig economy on worker livelihoods. Transfer 23(2):135–162.CrossrefGoogle Scholar
  • Hambleton RK, Swaminathan H, Rogers HJ (1991) Fundamentals of Item Response Theory (Sage Publications, Newbury Park, CA).Google Scholar
  • Hendrikx F, Bubendorfer K (2013) Malleable access rights to establish and enable scientific collaboration. Proc. 9th Internat. Conf. e-Science (IEEE, New York), 334–341.Google Scholar
  • Hendrikx F, Bubendorfer K, Chard R (2015) Reputation systems: A survey and taxonomy. J. Parallel Distributed Comput. 75:184–197.CrossrefGoogle Scholar
  • Ho Y-C, Wu J, Tan Y (2017) Disconfirmation effect on online rating behavior: A structural model. Inform. Systems Res. 28(3):626–642.LinkGoogle Scholar
  • Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput. 9(8):1735–1780.CrossrefGoogle Scholar
  • Horton JJ (2017) The effects of algorithmic labor market recommendations: Evidence from a field experiment. J. Labor Econom. 35(2):345–385.CrossrefGoogle Scholar
  • Hossain MS, Arefin MS (2019) Development of an intelligent job recommender system for freelancers using client’s feedback classification and association rule mining techniques. J. Software 14(7):312–339.CrossrefGoogle Scholar
  • Hsueh S-C, Lin M-Y, Chen C-L (2008) Mining negative sequential patterns for e-commerce recommendations. Proc. Asia-Pacific Services Comput. Conf. (IEEE, New York), 1213–1218.Google Scholar
  • Hu N, Pavlou PA, Zhang J (2017) On self-selection biases in online product reviews. MIS Quart. 41(2):449–471.CrossrefGoogle Scholar
  • Hu N, Zhang J, Pavlou PA (2009) Overcoming the j-shaped distribution of product reviews. Comm. ACM 52(10):144–147.CrossrefGoogle Scholar
  • Huber PJ (2011) Robust Statistics (Springer, Berlin).Google Scholar
  • IBM Institute for Business Value (2019) The enterprise guide to closing the skills gap. Retrieved December 2, https://www.ibm.com/downloads/cas/EPYMNBJA.Google Scholar
  • Ipeirotis P 2013. Badges and the Lake Wobegon effect. Retrieved December 30, 2018, https://www.behind-the-enemy-lines.com/2013/10/badges-and-lake-wobegon-effect.html.Google Scholar
  • Jagabathula S, Subramanian L, Venkataraman A (2014) Reputation-based worker filtering in crowdsourcing. Ghahramani Z, Welling M, Cortes C, Lawrence N, Weinberger KQ, eds. Advances in Neural Information Processing Systems (Curran Associates, Red Hook, NY), 2492–2500.Google Scholar
  • Jain H, Padmanabhan B, Pavlou PA, Santanam RT (2018) Call for papers–special issue of information systems research–humans, algorithms, and augmented intelligence: The future of work, organizations, and society. Inform. Systems Res. 29(1):250–251.LinkGoogle Scholar
  • Jannach D, Lerche L, Jugovac M (2015) Adaptation and evaluation of recommendations for short-term shopping goals. RecSys ’15: Proc. 9th ACM Conf. Recommender Systems (ACM, New York), 211–218.Google Scholar
  • Jerath K, Fader PS, Hardie GSB (2011) New perspectives on customer “death” using a generalization of the pareto/nbd model. Marketing Sci. 30(5):866–880.LinkGoogle Scholar
  • Jøsang A, Golbeck J (2009) Challenges for robust trust and reputation systems. Proc. 5th Internat. Workshop Security Trust Management.Google Scholar
  • Jøsang A, Guo G, Pini MS, Santini F, Xu Y (2013) Combining recommender and reputation systems to produce better online advice. Torra V, Narukawa Y, Navarro-Arribas G, Megías D, eds. Proc. Internat. Conf. Modeling Decisions Artificial Intelligence (Springer, Berlin), 126–138.Google Scholar
  • Jøsang A, Ismail R, Boyd C (2007) A survey of trust and reputation systems for online service provision. Decision Support Systems 43(2):618–644.CrossrefGoogle Scholar
  • Jurczyk P, Agichtein E (2007) Discovering authorities in question answer communities by using link analysis. CIKM ’07: Proc. 16th ACM Conf. Inform. Knowledge Management (ACM, New York), 919–922.Google Scholar
  • Kamvar SD, Schlosser MT, Garcia-Molina H (2003) The Eigentrust algorithm for reputation management in P2P networks. WWW ’03: Proc. 12th Internat. Conf. World Wide Web (ACM, New York), 640–651.Google Scholar
  • Kanat I, Hong Y, Santanam RT (2018) Surviving in global online labor markets for IT services: A geo-economic analysis. Inform. Systems Res. 29(4):893–909.LinkGoogle Scholar
  • Kantor BP, Rokach L, Ricci F, Shapira B, eds. (2011) Recommender Systems Handbook (Springer, Boston).Google Scholar
  • Kendall MG (1938) A new measure of rank correlation. Biometrika 30(1–2):81–93.CrossrefGoogle Scholar
  • Kohl M (2019) Totalvardist: Generic function for the computation of the total variation distance of two distributions. Retrieved December 2, https://www.rdocumentation.org/packages/distrEx/versions/2.5/topics/TotalVarDist.Google Scholar
  • Kokkodis M (2018) Dynamic recommendations for sequential hiring decisions in online labor markets. KDD ’18: Proc. 24th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 453–461.Google Scholar
  • Kokkodis M (2020) Diversify or specialize? Skillset diversification in online labor markets: Reputation losses and opportunity gains. Working paper.Google Scholar
  • Kokkodis M, Ipeirotis PG (2014) The utility of skills in online labor markets. Proc. 35th Internat. Conf. Inform. Systems.Google Scholar
  • Kokkodis M, Ipeirotis PG (2016) Reputation transferability in online labor markets. Management Sci. 62(6):1687–1706.LinkGoogle Scholar
  • Kokkodis M, Ipeirotis PG (2020) Demand-aware career path recommendations: A reinforcement learning approach. Manage. Sci. Forthcoming.LinkGoogle Scholar
  • Kokkodis M, Lappas T (2020) Your hometown matters: Popularity-difference bias in online reputation platforms. Inform. Systems Res. 31(2):412–430.LinkGoogle Scholar
  • Kokkodis M, Lappas T, Kane G (2020a) Direct and indirect effects of introducing purchase verification in e-commerce platforms. Working paper.Google Scholar
  • Kokkodis M, Lappas T, Ransbotham S (2020b) From lurkers to workers: Predicting voluntary contribution and community welfare. Inf.orm Systems Res. 31(2):607–626.LinkGoogle Scholar
  • Kokkodis M, Papadimitriou P, Ipeirotis PG (2015) Hiring behavior models for online labor markets. WSDM ’15: Proc. 8th ACM Internat. Conf. Web Search Data Mining (ACM, New York), 223–232.Google Scholar
  • Kokkodis M, Ransbotham S (2020) Asymmetric reputation spillover from agencies on digital platforms. Working paper.Google Scholar
  • Koren Y (2010) Collaborative filtering with temporal dynamics. Commun. ACM 53(4):89–97.Google Scholar
  • Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37.CrossrefGoogle Scholar
  • Kuhn P, Skuterud M (2004) Internet job search and unemployment durations. Amer. Econom. Rev. 94(1):218–232.CrossrefGoogle Scholar
  • Kula M (2018) Deep recommender models using PyTorch. Retrieved December 2, 2019, https://github.com/maciejkula/spotlight.Google Scholar
  • Kung-Hsiang H (2018) Introduction to recommender systems: Part 2 (neural network approach). Towards Data Sci., February 16, https://towardsdatascience.com/introduction-to-recommender-system-part-2-adoption-of-neural-network-831972c4cbf7.Google Scholar
  • Le Q, Mikolov T (2014) Distributed representations of sentences and documents. Proc. 31st Internat. Conf. Machine Learning (JMLR, Cambridge, MA), 1188–1196.Google Scholar
  • Lee G, Raghu TS (2014) Determinants of mobile apps’ success: Evidence from the appstore market. J. Management Inform. Systems 31(2):133–170.CrossrefGoogle Scholar
  • Lemire D, Maclachlan A 2005. Slope one predictors for online rating-based collaborative filtering. Proc. Internat. Conf. Data Mining (SIAM, Philadelphia), 471–475.Google Scholar
  • Lin M, Liu Y, Viswanathan S (2016) Effectiveness of reputation in contracting for customized production: Evidence from online labor markets. Management Sci. 64(1):345–359.LinkGoogle Scholar
  • Longadge R, Dongre S (2013) Class imbalance problem in data mining review. Preprint, submitted May 8, https://arxiv.org/abs/1305.1707.Google Scholar
  • Lu X, Ba S, Huang L, Feng Y (2013) Promotional marketing or word-of-mouth? Evidence from online restaurant reviews. Inform. Systems Res. 24(3):596–612.LinkGoogle Scholar
  • Luca M (2016) Reviews, reputation, and revenue: The case of yelp.com. Working paper, Harvard University, Boston.Google Scholar
  • Luca M (2017) Designing online marketplaces: Trust and reputation mechanisms. Innovation Policy Econom. 17:77–93.CrossrefGoogle Scholar
  • Luca M, Zervas G (2016) Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Sci. 62(12):3412–3427.LinkGoogle Scholar
  • Meyer F (2012) Recommender systems in industrial contexts. Preprint, submitted March 20, https://arxiv.org/abs/1203.4487.Google Scholar
  • Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. Preprint, submitted January 16, https://arxiv.org/abs/1301.3781.Google Scholar
  • Moe WW, Schweidel DA (2012) Online product opinions: Incidence, evaluation, and evolution. Marketing Sci. 31(3):372–386.LinkGoogle Scholar
  • Moreno A, Terwiesch C (2014) Doing business with strangers: Reputation in online service marketplaces. Inform. Systems Res. 25(4):865–886.LinkGoogle Scholar
  • Murphy KP (2012) Machine learning: A Probabilistic Perspective (MIT Press, Cambridge, MA).Google Scholar
  • Nica E, Potcovaru A-M, Mirică C-O (2017) A question of trust: Cognitive capitalism, digital reputation economy, and online labor markets. Econom. Management Financial Markets 12(3):64–69.CrossrefGoogle Scholar
  • Oliver B (2015) Redefining graduate employability and work-integrated learning: Proposals for effective higher education in disrupted economies. J. Teaching Learning Graduate Employability 6(1):56–65.CrossrefGoogle Scholar
  • Pallais A (2014) Inefficient hiring in entry-level labor markets. Amer. Econom. Rev. 104(11):3565–3599.CrossrefGoogle Scholar
  • Paolacci G, Chandler J, Ipeirotis PG (2010) Running experiments on amazon mechanical turk. Judgment Decision Making 5(5):411–419.CrossrefGoogle Scholar
  • Patel B, Kakuste V, Eirinaki M (2017) CaPaR: A career path recommendation framework. Proc. Internat. Conf. Big Data Comput. Service Appl. (BigDataService) (IEEE, New York), 23–30.Google Scholar
  • Pavlou PA, Gefen D (2004) Building effective online marketplaces with institution-based trust. Inform. Systems Res. 15(1):37–59.LinkGoogle Scholar
  • Pelechrinis K, Zadorozhny V, Kounev V, Oleshchuk V, Anwar M, Lin Y (2015) Automatic evaluation of information provider reliability and expertise. World Wide Web 18:33–72.CrossrefGoogle Scholar
  • Proserpio D, Zervas G (2017) Online reputation management: Estimating the impact of management responses on consumer reviews. Marketing Sci. 36(5):645–665.LinkGoogle Scholar
  • Quadrana M, Cremonesi P, Jannach D (2018) Sequence-aware recommender systems. ACM Comput. Surveys 51(4):66.CrossrefGoogle Scholar
  • Rahman H (2018a) Don’t worship the stars: Ratings inflation in online labor markets. Proc. Internat. Conf. Inform. Systems (AIS, Atlanta).Google Scholar
  • Rahman HA (2018b) Reputational ploys: Reputation and ratings in online markets. Acad. Management Proc. 2018(1).CrossrefGoogle Scholar
  • Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. WWW ’10: Proc. 19th Internat. Conf. World Wide Web (ACM, New York), 811–820.Google Scholar
  • Ricci F, Rokach L, Shapira B (2011) Introduction to Recommender Systems Handbook. Ricci F, Rokach L, Shapira S, Kantor PB, eds. Recommender Systems Handbook (Springer, Boston), 1–35.CrossrefGoogle Scholar
  • Sabater J, Sierra C (2001a) REGRET: Reputation in gregarious societies. AGENTS ’01: Proc. 5th Internat. Conf. Autonomous Agents (ACM, New York), 194–195.Google Scholar
  • Sabater J, Sierra C (2001b) Social ReGreT, a reputation model based on social relations. ACM SIGecom Exchanges 3(1):44–56.CrossrefGoogle Scholar
  • Schmidt FL, Hunter JE (1983) Individual differences in productivity: An empirical test of estimates derived from studies of selection procedure utility. J. Appl. Psych. 68(3):407–414.CrossrefGoogle Scholar
  • Smola AJ, Schölkopf B (2004) A tutorial on support vector regression. Statistics Comput. 14:199–222.CrossrefGoogle Scholar
  • Spearman C (1904) The proof and measurement of association between two things. Amer. J. Psych. 15:72–101.CrossrefGoogle Scholar
  • Stack Overflow (2018) What is reputation? How do I earn (and lose) it? Retrieved December 2, 2019, https://stackoverflow.com/help/whats-reputation.Google Scholar
  • Stevenson B (2009) The Internet and job search. Autor DH, ed. Studies of Labor Market Intermediation (University of Chicago Press, Chicago), 67–86.CrossrefGoogle Scholar
  • Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv. Artificial Intelligence 2009:4.CrossrefGoogle Scholar
  • Sundararajan A (2016) The Sharing Economy: The End of Employment and the Rise of Crowd-Based Capitalism (MIT Press, Cambridge, MA).Google Scholar
  • Tadelis S (2016) Reputation and feedback systems in online platform markets. Annu. Rev. Econom. 8:321–340.CrossrefGoogle Scholar
  • Tian C, Yang B (2011) R2Trust, a reputation and risk based trust management framework for large-scale, fully decentralized overlay networks. Future Generation Comput. Systems 27(8):1135–1141.CrossrefGoogle Scholar
  • Tripp MT, Grégoire Y (2011) When unhappy customers strike back on the Internet. MIT Sloan Management Rev. 52:37–44.Google Scholar
  • Turkopticon (2018) Turkopticon. Retrieved December 2, 2019, https://turkopticon.ucsd.edu/.Google Scholar
  • Upwork (2014) Online work report. Retrieved April 28, 2019, https://web.archive.org/web/20180228011632/http://elance-odesk.com:80/online-work-report-global.Google Scholar
  • Upwork (2018) Add certifications. Retrieved December 2, 2019, https://support.upwork.com/hc/en-us/articles/215650138-Add-Certifications.Google Scholar
  • Wood-Doughty A (2018) The role of reputation systems in an online labor market. Working paper.Google Scholar
  • Xie H, Lui JCS, Towsley D (2015) Incentive and reputation mechanisms for online crowdsourcing systems. Proc. 23rd Internat. Sympos. Quality Service (IWQoS) (IEEE, New York), 207–212.Google Scholar
  • Xiong L, Liu L (2004) PeerTrust: Supporting reputation-based trust for peer-to-peer electronic communities. Trans. Knowledge Data Engrg. 16(7):843–857.CrossrefGoogle Scholar
  • Ye Q, Law R, Gu B (2009) The impact of online user reviews on hotel room sales. Internat. J. Hospital Management 28(1):180–182.CrossrefGoogle Scholar
  • Yoganarasimhan H (2013) The value of reputation in an online freelance marketplace. Marketing Sci. 32(6):860–891.LinkGoogle Scholar
  • Zang H, Xu Y, Li Y (2010) Non-redundant sequential association rule mining and application in recommender systems. Proc. IEEE/WIC/ACM Internat. Conf. Web Intelligence Intelligent Agent Tech., vol.3. (IEEE, New York), 292–295.Google Scholar
  • Zervas G, Proserpio D, Byers J (2015) A first look at online reputation on Airbnb, where every stay is above average. Working paper.Google Scholar
  • Zhang J, Ackerman MS, Adamic L (2007) Expertise networks in online communities: structure and algorithms. WWW ’07: Proc. 16th Internat. Conf. World Wide Web (ACM, New York), 221–230.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.