Abstract
Popularity of mobile apps is traditionally measured by metrics such as the number of downloads, installations, or user ratings. A problem with these measures is that they reflect usage only indirectly. Indeed, retention rates, i.e., the number of days users continue to interact with an installed app, have been suggested to predict successful app lifecycles. We conduct the first independent and large-scale study of retention rates and usage trends on a dataset of app-usage data from a community of 339,842 users and more than 213,667 apps. Our analysis shows that, on average, applications lose 65% of their users in the first week, while very popular applications (top 100) lose only 35%. It also reveals, however, that many applications have more complex usage behaviour patterns due to seasonality, marketing, or other factors. To capture such effects, we develop a novel app-usage trend measure which provides instantaneous information about the popularity of an application. Analysis of our data using this trend filter shows that roughly 40% of all apps never gain more than a handful of users (Marginal apps). Less than 0.1% of the remaining 60% are constantly popular (Dominant apps), 1% have a quick drain of usage after an initial steep rise (Expired apps), and 6% continuously rise in popularity (Hot apps). From these, we can distinguish, for instance, trendsetters from copycat apps. We conclude by demonstrating that usage behaviour trend information can be used to develop better mobile app recommendations.
- Hirotugu Akaike. 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control 19, 6 (1974), 716--723.Google Scholar
Cross Ref
- Donghwan Bae, Keejun Han, Juneyoung Park, and Mun Y. Yi. 2015. AppTrends: A graph-based mobile app recommendation system using usage history. In Proceedings of the International Conference on Big Data and Smart Computing (BigComp). IEEE, 210--216.Google Scholar
- Ricardo Baeza-Yates, Di Jiang, Fabrizio Silvestri, and Beverly Harrison. 2015. Predicting the next app that you are going to use. In Proceedings of the 8th ACM International Conference on Web Search and Data Mining (WSDM’15). ACM, 285--294. Google Scholar
Digital Library
- James Benhardus and Jugal Kalita. 2013. Streaming trend detection in Twitter. International Journal on Web Based Communities 9 (2013), 122--139. Google Scholar
Digital Library
- Matthias Böhmer, Brent Hecht, Johannes Schöning, Antonio Krüger, and Gernot Bauer. 2011. Falling asleep with Angry birds, Facebook and Kindle: A large scale study on mobile application usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI’11). ACM, New York, NY, USA, 47--56. Google Scholar
Digital Library
- Matthias Böhmer and Antonio Krüger. 2013. A study on icon arrangement by smartphone users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, USA, 2137--2146. Google Scholar
Digital Library
- George E. P. Box, Gwilym M. Jenkins, Gregory C. Reinsel, and Greta M. Ljung. 2015. Time Series Analysis: Forecasting and Control. John Wiley 8 Sons.Google Scholar
- Andrew P. Bradley. 1997. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30, 7 (1997), 1145--1159. Google Scholar
Digital Library
- Peter J. Brockwell and Richard A. Davis. 2013. Time Series: Theory and Methods. Springer Science 8 Business Media.Google Scholar
- Mario Cataldi, Luigi Di Caro, and Claudio Schifanella. 2010. Emerging topic detection on Twitter based on temporal and social terms evaluation. In Proceedings of the 10th International Workshop on Multimedia Data Mining. 1--10. Google Scholar
Digital Library
- Rishi Chandy and Haijie Gu. 2012. Identifying spam in the iOS app store. In Proceedings of the 2nd Joint WICOW/AIRWeb Workshop on Web Quality (WebQuality’12). ACM, New York, 56--59. Google Scholar
Digital Library
- Ning Chen, Jialiu Lin, Steven C. H. Hoi, Xiaokui Xiao, and Boshen Zhang. 2014. AR-miner: Mining informative reviews for developers from mobile app marketplace. In Proceedings of the 36th International Conference on Software Engineering (ICSE’14). 767--778. Google Scholar
Digital Library
- Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the 4th ACM Conference on Recommender Systems. 39--46. Google Scholar
Digital Library
- Mark de Reuver, Harry Bouwman, Nico Heerschap, and Hannu Verkasalo. 2012. Smartphone measurement: Do people use mobile applications as they say they do? In Proceedings of the International Conference on Mobile Business (ICMB’12). 2--13.Google Scholar
- Bin Fu, Jialiu Lin, Lei Li, Christos Faloutsos, Jason I. Hong, and Norman M. Sadeh. 2013. Why people hate your app: Making sense of user feedback in a mobile app store. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Google Scholar
Digital Library
- Andrea Girardello and Florian Michahelles. 2010. AppAware: Which mobile applications are hot?. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI’10). ACM, New York, 431--434. Google Scholar
Digital Library
- Alessandra Gorla, Ilaria Tavecchia, Florian Gross, and Andreas Zeller. 2014. Checking app behaviour against app descriptions. In Proceedings of the 36th International Conference on Software Engineering (ICSE’14). ACM, New York, 1025--1035. Google Scholar
Digital Library
- Emitza Guzman and Walid Maalej. 2014. How do users like this feature? A fine grained sentiment analysis of app reviews. In Proceedings of the IEEE International Requirements Engineering Conference (RE’14). 153--162.Google Scholar
Cross Ref
- James Douglas Hamilton. 1994. Time Series Analysis. Vol. 2. Princeton University Press, Princeton.Google Scholar
- Mark Harman, Yue Jia, and Yuanyuan Zhang. 2012. App store mining and analysis: MSR for app stores. In Proceedings of the 9th IEEE Working Conference on Mining Software Repositories (MSR’12). IEEE Press, 108--111. Google Scholar
Digital Library
- Xin Jin and Jiawei Han. 2010. K-Means Clustering. Springer US, Boston, MA, 563--564.Google Scholar
- Nitin Jindal and Bing Liu. 2008. Opinion spam and analysis. In Proceedings of the 2008 International Conference on Web Search and Data Mining (WSDM’08). ACM, New York, 219--230. Google Scholar
Digital Library
- Alexandros Karatzoglou, Linas Baltrunas, Karen Church, and Matthias Böhmer. 2012. Climbing the app wall: Enabling mobile app discovery through context-aware recommendations. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management (CIKM’12). ACM, New York, 2527--2530. Google Scholar
Digital Library
- Hammad Khalid, Emad Shihab, Meiyappan Nagappan, and Ahmed E. Hassan. 2015. What do mobile app users complain about? IEEE Software 32 (2015), 70--77.Google Scholar
Digital Library
- Hee-Woong Kim, Hyun-Lyung Lee, and Su-Jin Choi. 2011. An exploratory study on the determinants of mobile application purchase. The Journal of Society for E-Business Studies 16, 4 (2011), 173--195.Google Scholar
Cross Ref
- Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Communications of the ACM 53, 4 (2010), 89--97. Google Scholar
Digital Library
- Neal Lathia, Stephen Hailes, Licia Capra, and Xavier Amatriain. 2010. Temporal diversity in recommender systems. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’10). ACM, New York, 210--217. Google Scholar
Digital Library
- Soo Ling Lim, Peter J. Bentley, Natalie Kanakam, Fuyuki Ishikawa, and Shinichi Honiden. 2015. Investigating country differences in mobile app user behaviour and challenges for software engineering. IEEE Transactions on Software Engineering 41, 1 (Jan. 2015), 40--64.Google Scholar
Digital Library
- Jovian Lin, Kazunari Sugiyama, Min-Yen Kan, and Tat-Seng Chua. 2014. New and improved: Modeling versions to improve app recommendation. In Proceedings of the 37th international ACM SIGIR Conference on Research 8 Development in Information Retrieval. ACM, 647--656. Google Scholar
Digital Library
- Rui Liu, Jiannong Cao, Kehuan Zhang, Wenyu Gao, Lei Yang, Junbin Liang, and Ruiyun Yu. 2016. Understanding mobile users’ privacy expectations: A recommendation-based method through crowdsourcing. IEEE Transactions on Services Computing (Dec. 2016).Google Scholar
Cross Ref
- Michael Mathioudakis and Nick Koudas. 2010. Twittermonitor: Trend detection over the twitter stream. In Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data. 1155--1158. Google Scholar
Digital Library
- Charles R. Nelson and Charles R. Plosser. 1982. Trends and random walks in macroeconmic time series: Some evidence and implications. Journal of Monetary Economics 10, 2 (1982), 139--162.Google Scholar
Cross Ref
- Adam J. Oliner, Anand P. Iyer, Ion Stoica, Eemil Lagerspetz, and Sasu Tarkoma. 2013. Carat: Collaborative energy diagnosis for mobile devices. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. ACM, New York, Article 10, 14 pages. Google Scholar
Digital Library
- Dennis Pagano and Walid Maalej. 2013. User feedback in the appstore: An empirical study. In 2013 21st IEEE International Requirements Engineering Conference (RE’13). IEEE, 125--134.Google Scholar
Cross Ref
- Thanasis Petsas, Antonis Papadogiannakis, Michalis Polychronakis, Evangelos P. Markatos, and Thomas Karagiannis. 2013. Rise of the planet of the apps: A systematic study of the mobile app ecosystem. In Proceedings of the 2013 Conference on Internet Measurement Conference (IMC’13). ACM, New York, 277--290. Google Scholar
Digital Library
- Pavel A. Pevzner. 2000. Computational Molecular Biology—An Algorithmic Approach. MIT Press.Google Scholar
Cross Ref
- Alexandrin Popescul, Gary William Flake, Steve Lawrence, Lyle H. Ungar, and C. Lee Giles. 2000. Clustering and identifying temporal trends in document databases. In Proceedings of Advances in Digital Libraries, 2000. 173--182. Google Scholar
Digital Library
- Kira Radinsky, Krysta Svore, Susan Dumais, Jaime Teevan, Alex Bocharov, and Eric Horvitz. 2012. Modeling and predicting behavioral dynamics on the web. In Proceedings of the 21st International Conference on World Wide Web. 599--608. Google Scholar
Digital Library
- Lenin Ravindranath, Jitendra Padhye, Sharad Agarwal, Ratul Mahajan, Ian Obermiller, and Shahin Shayandeh. 2012. AppInsight: Mobile app performance monitoring in the wild. In OSDI, Vol. 12. 107--120. Google Scholar
Digital Library
- Kent Shi and Kamal Ali. 2012. GetJar mobile application recommendations with very sparse datasets. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’12). ACM, New York, 204--212. Google Scholar
Digital Library
- Olga Streibel and Rehab Alnemr. 2011. Trend-based and reputation-versed personalized news network. In Proceedings of the 3rd International Workshop on Search and Mining User-generated Contents (SMUC’11). ACM, New York, 3--10. Google Scholar
Digital Library
- Hien Truong, Eemil Lagerspetz, Petteri Nurmi, Adam Oliner, Sasu Tarkoma, and N. Asokan. 2014. The company you keep: Mobile malware infection rates and inexpensive risk indicators. In Proceedings of the 23rd International Conference on World Wide Web (WWW’14). ACM, 39--50. Google Scholar
Digital Library
- Sergei Vassilvitskii. 2007. K-means: Algorithms, Analyses, Experiments. Ph.D. Dissertation. Stanford, CA. Advisor(s) Motwani, Rajeev. Google Scholar
Digital Library
- Fei Wang, Zhe Zhang, Hailong Sun, Richong Zhang, and Xudong Liu. 2013. A cooperation based metric for mobile applications recommendation. In 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), Vol. 3. IEEE, 13--16. Google Scholar
Digital Library
- Tingting Wang, Di Wu, Jiaming Zhang, Min Chen, and Yipeng Zhou. 2016. Measuring and analyzing third-party mobile game app stores in China. IEEE Transactions on Network and Service Management 13, 4 (Dec. 2016), 793--805. Google Scholar
Digital Library
- Xiao Xia, Xiaodong Wang, Jian Li, and Xingming Zhou. 2014. Multi-objective mobile app recommendation: A system-level collaboration approach. Computers 8 Electrical Engineering 40, 1 (2014), 203--215. Google Scholar
Digital Library
- Ye Xu, Mu Lin, Hong Lu, Giuseppe Cardone, Nicholas Lane, Zhenyu Chen, Andrew Campbell, and Tanzeem Choudhury. 2013. Preference, context and communities: A multi-faceted approach to predicting smartphone app usage patterns. In Proceedings of the 2013 International Symposium on Wearable Computers. ACM, 69--76. Google Scholar
Digital Library
- Bo Yan and Guanling Chen. 2011. AppJoy: Personalized mobile application discovery. In Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services (MobiSys’11). ACM, New York, 113--126. Google Scholar
Digital Library
- Peifeng Yin, Ping Luo, Wang-Chien Lee, and Min Wang. 2013. App recommendation: A contest between satisfaction and temptation. In Proceedings of the 6th ACM International Conference on Web Search and Data Mining. ACM, 395--404. Google Scholar
Digital Library
- Nan Zhong and Florian Michahelles. 2013. Google play is not a long tail market: An empirical analysis of app adoption on the Google play app market. In Proceedings of the 28th Annual ACM Symposium on Applied Computing. 499--504. Google Scholar
Digital Library
- Hengshu Zhu, Chuanren Liu, Yong Ge, Hui Xiong, and Enhong Chen. 2015. Popularity modeling for mobile apps: A sequential approach. IEEE Transactions on Cybernetics 45, 7 (2015), 1303--1314.Google Scholar
Cross Ref
- Upasna Bhandari, Kazunari Sugiyama, Anindya Datta, and Rajni Jindal. 2013. Serendipitous recommendation for mobile apps using item-item similarity graph. Asia Information Retrieval Symposium. 440--451.Google Scholar
Cross Ref
- Zhung-Xun Liao, Wen-Chih Peng, and S. Yu Philip. 2013. Mining usage traces of mobile apps for dynamic preference prediction. Asia-Pacific Conference on Knowledge Discovery and Data Mining. 339--353.Google Scholar
Index Terms
Exploiting Usage to Predict Instantaneous App Popularity: Trend Filters and Retention Rates
Recommendations
A Measurement-based Study on Application Popularity in Android and iOS App Stores
Mobidata '15: Proceedings of the 2015 Workshop on Mobile Big DataMobile application stores (appstores) are emerging digital distribution platforms with explosive growth. Although there have been some observations on the mobile application (app) popularity in Android appstores, there is no report on the app popularity ...
A lightweight user tracking method for app providers
CF '16: Proceedings of the ACM International Conference on Computing FrontiersSince 2013, Google and Apple no longer allow app providers to use the persistent device identifiers (Android ID and UDID) for user tracking on mobile devices. Other tracking options provoke either severe privacy concerns, need additional hardware or are ...
Estimating Demand for Mobile Applications in the New Economy
In 2013, the global mobile app market was estimated at over US$50 billion and is expected to grow to $150 billion in the next two years. In this paper, we build a structural econometric model to quantify the vibrant platform competition between mobile ...






Comments