DataStormFE: A Data-and decision-flow and coordination engine for coupled simulation ensembles

Hans Walter Behrens, Kasim Candan, Xilun Chen, Ashish Gadkari, Yash Garg, Mao Lin Li

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations


Data- and model-driven computer simulations are increasingly critical in many application domains. Yet, several critical data challenges remain in obtaining and leveraging simulations in decision making. Simulations may track 100s of parameters, spanning multiple layers and spatialtemporal frames, affected by complex inter-dependent dynamic processes. Moreover, due to the large numbers of unknowns, decision makers usually need to generate ensembles of stochastic realizations, requiring 10s-1000s of individual simulation instances. The situation on the ground evolves unpredictably, requiring continuously adaptive simulation ensembles. We introduce the DataStorm framework for simulation ensemble management, and demonstrate its DataStorm-FE data- and decisionow and coordination engine for creating and maintaining coupled, multi-model simulation ensembles. DataStorm-FE enables end-to-end ensemble planning and optimization, including parameter-space sampling, output aggregation and alignment, and state and provenance data management, to improve the overall simulation process. It also aims to work effciently, producing results while working within a limited simulation budget, and incorporates a multivariate, spatiotemporal data browser to empower decision-making based on these improved results.

Original languageEnglish (US)
Pages (from-to)1906-1909
Number of pages4
JournalProceedings of the VLDB Endowment
Issue number12
StatePublished - 2018
Event44th International Conference on Very Large Data Bases, VLDB 2018 - Rio de Janeiro, Brazil
Duration: Aug 27 2018Aug 31 2018

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • General Computer Science


Dive into the research topics of 'DataStormFE: A Data-and decision-flow and coordination engine for coupled simulation ensembles'. Together they form a unique fingerprint.

Cite this