Abstract
Urban systems are characterized by complexity and dynamicity. Data-driven simulations represent a promising approach in understanding and predicting complex dynamic processes in the presence of shifting demands of urban systems. Yet, today’s silo-based, de-coupled simulation engines fail to provide an end-to-end view of the complex urban system, preventing informed decision-making. In this article, we present
- Ilkay Altintas, Chad Berkley, Efrat Jaeger, Matthew Jones, Bertram Ludäscher, and Stephen Mock. 2004. Kepler: An extensible system for design and execution of scientific workflows. In Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM’04), Vol. 16. 423–424. DOI:https://doi.org/10.1109/SSDBM.2004.44 Google Scholar
Digital Library
- Ilkay Altintas, Jianwu Wang, Daniel Crawl, and Weizhong Li. 2012. Challenges and approaches for distributed workflow-driven analysis of large-scale biological data: Vision paper. In Proceedings of the Joint EDBT/ICDT Workshops (EDBT-ICDT’12). ACM, New York, NY, 73–78. DOI:https://doi.org/10.1145/2320765.2320791 Google Scholar
Digital Library
- Duygu Balcan, Bruno Gonçalves, Hao Hu, José J. Ramasco, Vittoria Colizza, and Alessandro Vespignani. 2010. Modeling the spatial spread of infectious diseases: The GLobal epidemic and mobility computational model. J. Comput. Sci. 1, 3 (Aug. 2010), 132–145. DOI:https://doi.org/10.1016/j.jocs.2010.07.002Google Scholar
- Michael Batty. 2013. Visually-driven urban simulation: Exploring fast and slow change in residential location. Environ. Plan. A: Econ. Space 45, 3 (2013), 532–552.Google Scholar
- Hans Walter Behrens, K. Selçuk Candan, Xilun Chen, Ashish Gadkari, Yash Garg, Mao-Lin Li, Xinsheng Li, Sicong Liu, Nicholas Martinez, Jiayong Mo, Elliot Nester, Silvestro Poccia, Manjusha Ravindranath, and Maria Luisa Sapino. 2018. Datastorm-FE: A data- and decision-flow and coordination engine for coupled simulation ensembles. Proc. VLDB Endow. 11, 12 (Aug. 2018), 1906–1909. Google Scholar
Digital Library
- Hans Walter Behrens, Mao-Lin Li, Ashish Gadkari, Yash Garg, Xilun Chen, Sicong Liu, and K. Selçuk Candan. 2019. Load-adaptive continuous coupled-simulation ensembles with DataStorm and Chameleon. In Proceedings of the Chameleon User Meeting.Google Scholar
- Chun-Hung Chen and Loo Hay Lee. 2010. Stochastic Simulation Optimization - An Optimal Computing Budget Allocation. System Engineering and Operations Research, Vol. 1. WorldScientific. Google Scholar
Digital Library
- Committee on Environment and Natural Resources. 2008. Grand challenges for disaster reduction. Executive Office of the President (2008). https://www.sdr.gov/docs/SDRGrandChallengesforDisasterReduction.pdf.Google Scholar
- Greg Cope. 2017. Programming the Lorenz Attractor. Retrieved from https://www.algosome.com/articles/lorenz-attractor-programming-code.htmlGoogle Scholar
- Laurent Guillaume Courty, Adrián Pedrozo-Acuña, and Paul David Bates. 2017. Itzï (Version 17.1): An open-source, distributed GIS model for dynamic flood simulation. Geosci. Model Dev. 10, 4 (May 2017), 1835–1847. DOI:https://doi.org/10.5194/gmd-10-1835-2017Google Scholar
- Christopher Davis, Wei Wang, Shuyi S. Chen, Yongsheng Chen, Kristen Corbosiero, Mark DeMaria, Jimy Dudhia, Greg Holland, Joe Klemp, John Michalakes, Heather Reeves, Richard Rotunno, Chris Snyder, and Qingnong Xiao. 2008. Prediction of landfalling hurricanes with the advanced hurricane WRF model. Month. Weath. Rev. 136, 6 (June 2008), 1990–2005. DOI:https://doi.org/10.1175/2007MWR2085.1Google Scholar
- Stefan B. Edlund, Matthew A. Davis, and James H. Kaufman. 2010. The spatiotemporal epidemiological modeler. In Proceedings of the 1st ACM International Health Informatics Symposium (IHI’10). ACM, New York, NY, 817–820. DOI:https://doi.org/10.1145/1882992.1883115 Google Scholar
Digital Library
- Christoph Federrath. 2017. Java Applets. Retrieved from http://www.ita.uni-heidelberg.de/˜chfeder/applets.shtml?lang=en.Google Scholar
- Ronald Aylmer Fisher. 1935. The Design of Eexperiments. Oliver and Boyd.Google Scholar
- Ignacio Garcia-Dorado, Daniel G. Aliaga, Saiprasanth Bhalachandran, Paul Schmid, and Dev Niyogi. 2017. Fast weather simulation for inverse procedural design of 3D urban models. ACM Trans. Graph. 36, 2 (2017), 21:1–21:19. Google Scholar
Digital Library
- Michael Gollner, Arnaud Trouve, Ilkay Altintas, Jessica Block, Raymond de Callafon, Craig Clements, Anna Cortes, Evan Ellicott, Jean Baptiste Filippi, Mark Finney, Kayo Ide, Mary Ann Jenkins, Daniel Jimenez, Christopher Lautenberger, Jan Mandel, Melanie Rochoux, and Albert Simeoni. 2015. Towards data-driven operational wildfire spread modeling: A report of the NSF-funded WIFIRE workshop. (Jan. 2015). DOI:https://doi.org/10.13016/M2Z70RGoogle Scholar
- Richard A. Harshman. 1970. Foundations of The PARAFAC procedure: Models and conditions for an ‘explanatory” multimodal factor analysis. In UCLA Working Papers in Phonetics.Google Scholar
- Duncan Hull, Katy Wolstencroft, Robert Stevens, Carole Goble, Mathew R. Pocock, Peter Li, and Tom Oinn. 2006. Taverna: A tool for building and running workflows of services. Nucleic Acids Res. 34, Web Server issue (July 2006), W729–W732. DOI:https://doi.org/10.1093/nar/gkl320Google Scholar
- C. Jelesnianski, Jye Chen, W. Shaffer, and A. Gilad. 1984. SLOSH—A hurricane storm surge forecast model. In Proceedings of the OCEANS 1984 Conference. 314–317. DOI:https://doi.org/10.1109/OCEANS.1984.1152341Google Scholar
- I. Jeon, E. E. Papalexakis, U. Kang, and C. Faloutsos. 2015. HaTen2: Billion-scale tensor decompositions. In Proceedings of the IEEE 31st International Conference on Data Engineering. 1047–1058. DOI:https://doi.org/10.1109/ICDE.2015.7113355Google Scholar
- N. L. Johnson. 1961. Sequential analysis: A survey. J. Roy. Statist. Soc. Series A (General) 124, 3 (1961), 372–411. DOI:10.2307/2343243Google Scholar
Cross Ref
- Kate Keahey, Pierre Riteau, Dan Stanzione, Tim Cockerill, Joe Mambretti, Paul Rad, and Paul Ruth. 2018. Chameleon: A scalable production testbed for computer science research. In Contemporary High Performance Computing: From Petascale toward Exascale. CRC Press.Google Scholar
- Katarzyna Keahey, Mauricio Tsugawa, Andrea Matsunaga, and Jose Fortes. 2009. Sky computing. IEEE Internet Comput. 13, 5 (2009), 43–51. Google Scholar
Digital Library
- Ari Keranen. 2008. Opportunistic network environment simulator. In Proceedings of the 2nd International Conference on Simulation Tools and Techniques (SIMUTools'09). https://www.netlab.tkk.fi/tutkimus/dtn/theone/pub/the_one.pdf.Google Scholar
- Mijung Kim and K. Selçuk Candan. 2016. Decomposition-by-normalization (DBN): Leveraging approximate functional dependencies for efficient CP and Tucker decompositions. Data Mining Knowl. Discov. 30, 1 (Jan. 2016), 1–46. DOI:https://doi.org/10.1007/s10618-015-0401-6. Google Scholar
Digital Library
- Stefan Klus, Patrick Gelß, Sebastian Peitz, and Christof Schütte. 2018. Tensor-based dynamic mode decomposition. Nonlinearity 31, 7 (June 2018), 3359–3380. DOI:https://doi.org/10.1088/1361-6544/aabc8f.Google Scholar
- T. Kolda and B. Bader. 2009. Tensor decompositions and applications. SIAM Rev. 51, 3 (Aug. 2009), 455–500. DOI:https://doi.org/10.1137/07070111X. Google Scholar
Digital Library
- T. G. Kolda and J. Sun. 2008. Scalable tensor decompositions for multi-aspect data mining. In Proceedings of the 8th IEEE International Conference on Data Mining. 363–372. DOI:https://doi.org/10.1109/ICDM.2008.89. Google Scholar
Digital Library
- X. Li, K. S. Candan, and M. L. Sapino. 2018. M2TD: Multi-task tensor decomposition for sparse ensemble simulations. In Proceedings of the IEEE 34th International Conference on Data Engineering (ICDE’18). 1144–1155.Google Scholar
- X. Li, S. Huang, K. S. Candan, and M. L. Sapino. 2016. 2PCP: Two-phase CP decomposition for billion-scale dense tensors. In Proceedings of the IEEE 32nd International Conference on Data Engineering (ICDE’16). 835–846.Google Scholar
- Sicong Liu, Yash Garg, K. Selcuk Candan, Maria Luisa Sapino, and Gerardo Chowell-Puente. 2015. NOTES2: Networks-of-traces for epidemic spread simulations. In Proceedings of the Workshops at the 29th AAAI Conference on Artificial Intelligence.Google Scholar
- Sicong Liu, Silvestro Poccia, K. Selçuk Candan, Gerardo Chowell, and Maria Luisa Sapino. 2016. epiDMS: Data management and analytics for decision-making from epidemic spread simulation ensembles. J. Infect. Dis. 214, suppl_4 (2016), S427–S432.Google Scholar
- C. D. Tharindu Mathew, Paulo R. Knob, Soraia Raupp Musse, and Daniel G. Aliaga. 2019. Urban walkability design using virtual population simulation. Comput. Graph. Forum 38, 1 (2019), 455–469.Google Scholar
- Panayiotis Neophytou, Panos K. Chrysanthis, and Alexandros Labrinidis. 2011. CONFLuEnCE: CONtinuous workFLow ExeCution Engine. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD’11). ACM, New York, NY, 1311–1314. DOI:https://doi.org/10.1145/1989323.1989485 Google Scholar
Digital Library
- K. B. Olsen, S. M. Day, L. A. Dalguer, J. Mayhew, Y. Cui, J. Zhu, V. M. Cruz-Atienza, D. Roten, P. Maechling, T. H. Jordan, D. Okaya, and A. Chourasia. 2009. ShakeOut-D: Ground motion estimates using an ensemble of large earthquakes on the Southern San Andreas fault with spontaneous rupture propagation. Geophys. Res. Lett. 36, 4 (2009). DOI:https://doi.org/10.1029/2008GL036832Google Scholar
- Evangelos E. Papalexakis, Christos Faloutsos, and Nicholas D. Sidiropoulos. 2012. ParCube: Sparse parallelizable tensor decompositions. In Machine Learning and Knowledge Discovery in Databases (Lecture Notes in Computer Science), Peter A. Flach, Tijl De Bie, and Nello Cristianini (Eds.). Springer Berlin, 521–536. Google Scholar
- Giulia Pedrielli, Yinchao Zhu, and Loo Hay Lee. 2015. Single-run simulation optimization through time dilation and optimal computing budget allocation. http://www.smmso.org/SMMSO2015/Downloads/Giulia%20Pedrielli.pdf.Google Scholar
- Giulia Pedrielli, Yinchao Zhu, Loo Hay Lee, and Haobin Li. 2016. Empirical analysis of the performance of variance estimators in sequential single-run ranking & selection: The case of time dilation algorithm. In Proceedings of the Winter Simulation Conference (WSC’16). IEEE Press, Piscataway, NJ, 738–748. Google Scholar
Digital Library
- Silvestro Poccia, Maria Luisa Sapino, Sicong Liu, Xilun Chen, Yash Garg, Shengyu Huang, Jung Hyun Kim, Xinsheng Li, Parth Nagarkar, and Kasim Candan. 2017. SIMDMS: Data management and analysis to support decision making through large simulation ensembles. In Proceedings of the 20th International Conference on Extending Database Technology: Advances in Database Technology (EDBT’17). OpenProceedings.org, 582–585. DOI:https://doi.org/10.5441/002/edbt.2017.75.Google Scholar
- Mark Rogers, Lei Li, and Stuart J. Russell. 2013. Multilinear dynamical systems for tensor time series. In Advances in Neural Information Processing Systems 26, C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 2634–2642. Google Scholar
Digital Library
- L. W. Schruben. 1997. Simulation optimization using simultaneous replications and event time dilation. In Proceedings of the Winter Simulation Conference. 177–180. DOI:https://doi.org/10.1109/WSC.1997.640394. Google Scholar
Digital Library
- EmitLab DataStorm Team. 2018. DataStorm demo, v1. Retrieved from https://www.youtube.com/watch?v=L74jwa78Dg4.Google Scholar
- EmitLab DataStorm Team. 2018. DataStorm release, v1. Retrieved from https://github.com/EmitLab/DataStorm-Release.Google Scholar
- Ledyard R. Tucker. 1966. Some mathematical notes on three-mode factor analysis. Psychometrika 31, 3 (Sept. 1966), 279–311. DOI:https://doi.org/10.1007/BF02289464.Google Scholar
Cross Ref
- Paul Waddell. 2002. UrbanSim: Modeling urban development for land use, transportation, and environmental planning. J. Amer. Plan. Assoc. 68, 3 (2002), 297–314.Google Scholar
Cross Ref
- Denis Weerasiri, Moshe Chai Barukh, Boualem Benatallah, Quan Z. Sheng, and Rajiv Ranjan. 2017. A taxonomy and survey of cloud resource orchestration techniques. Comput. Surv. 50, 2 (May 2017), 1–41. Google Scholar
Digital Library
- Ming Zhao, K. Selçuk Candan, Huan Liu, Hasan Davulcu, and Fengbo Ren. 2016. NSF Award Search: Award#1629888 - II-NEW: GEARS - An Infrastructure for Energy-Efficient Big Data Research on Heterogeneous and Dynamic Data. Retrieved from https://nsf.gov/awardsearch/showAward?AWD_ID=1629888Google Scholar
Index Terms
DataStorm: Coupled, Continuous Simulations for Complex Urban Environments
Recommendations
Datastorm-FE: a data- and decision-flow and coordination engine for coupled simulation ensembles
Data- and model-driven computer simulations are increasingly critical in many application domains. Yet, several critical data challenges remain in obtaining and leveraging simulations in decision making. Simulations may track 100s of parameters, ...
Using the HLA for Distributed Continuous Simulations
EUROSIM '13: Proceedings of the 2013 8th EUROSIM Congress on Modelling and SimulationDistributed computing offers many advantages for all types of computational applications. Realizing heterogeneous simulation platforms may benefit from many facilities of distributed computing. However, distributing simulation components over a network ...
Simulations for Urban Planning: Designing for Human Values
Sophisticated simulation systems such as UrbanSim model the long-term impacts of transportation and land-use alternatives. Accounting for human values throughout the design process helps in designing interactions that engage both planners and citizens ...






Comments