CISL OpenSky Publications
Select a year and/or affiliation to see the peer-reviewed publications involving authors from CISL. The publications span data assimilation, machine learning, visualization, data analysis, model development, research computing operations, and data management services. You can view the full publications and search for specific publications in OpenSky, the open access repository of scholarly works developed and managed by the NSF NCAR Library.
Publications (Showing 116 of 1593 total) |
---|
Efficient GMRES+AMG on GPUs: Composite smoothers and mixed V-cycles Thomas, S., Baker, A.. (2024). Efficient GMRES+AMG on GPUs: Composite smoothers and mixed V-cycles. Siam Journal on Scientific Computing, doi:https://doi.org/10.1137/23M1578632 In this study, we introduce algorithms optimized for GPU architectures, aimed at efficiently solving large sparse linear systems, a central challenge in Navier–Stokes pressure projection problems. Our approach includes an adaptation ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
On a structural similarity index approach for floating-point data Baker, A., Pinard, A., Hammerling, D. M.. (2024). On a structural similarity index approach for floating-point data. IEEE Transactions on Visualization and Computer Graphics, doi:https://doi.org/10.1109/TVCG.2023.3332843 Data visualization is typically a critical component of post-processing analysis workflows for floating-point output data from large simulation codes, such as global climate models. For example, images are often created from the raw data as... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Global variability in atmospheric new particle formation mechanisms Zhao, B., Donahue, N. M., Zhang, K., Mao, L., Shrivastava, M., et al. (2024). Global variability in atmospheric new particle formation mechanisms. Nature, doi:https://doi.org/10.1038/s41586-024-07547-1 A key challenge in aerosol pollution studies and climate change assessment is to understand how atmospheric aerosol particles are initially formed 1,2 . Although new particle formation (NPF) mechanisms have been described at specific sites ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Report on the 2023 Workshop on Correctness and Reproducibility for Climate and Weather Software Altuntas, A., Baker, A., Carpenter, I., Dobbins, B., Duda, M. G., et al. (2024). Report on the 2023 Workshop on Correctness and Reproducibility for Climate and Weather Software. , doi:https://doi.org/10.5065/0534-mc88 A workshop on "Correctness and Reproducibility for Climate and Weather Software" was held on November 9-10, 2023, at the National Center for Atmospheric Research in Boulder, CO. This collaborative event brought together the NCAR application... CISL Affiliations: TDD, ASAP, CISLAODEPT Publication Genre: Technical Report View on OpenSky |
Randall, D., Hurrell, J., Dazlich, D., Sun, L., Feder, A., et al. (2023). EarthWorks. EarthWorks is a five-year university-based project, supported by NSF/CISE, to develop a global convection-permitting coupled model based on the CESM with GPU capability for all components. CISL Affiliations: CISLAODEPT, TDD, ASAP Publication Genre: Conference Material View on OpenSky |
The Community Software Facility: An investment in software is an investment in science Mickelson, S., Hauser, T., Romine, G., OKeefe, T.. (2023). The Community Software Facility: An investment in software is an investment in science. CISL Affiliations: TDD, ASAP, CISLAODEPT Publication Genre: Conference Material View on OpenSky |
North Atlantic subtropical mode water formation controlled by Gulf Stream fronts Gan, B., Yu, J., Wu, L., Danabasoglu, G., Small, R. J., et al. (2023). North Atlantic subtropical mode water formation controlled by Gulf Stream fronts. National Science Review, doi:https://doi.org/10.1093/nsr/nwad133 The North Atlantic Ocean hosts the largest volume of global subtropical mode waters (STMWs) in the world, which serve as heat, carbon and oxygen silos in the ocean interior. STMWs are formed in the Gulf Stream region where thermal fronts ar... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Proceedings of the 2023 Improving Scientific Software Conference Peterson, T., Vanderwende, B., Mickelson, S., Nusbaumer, J., Altuntas, A., et al. (2023). Proceedings of the 2023 Improving Scientific Software Conference. , doi:https://doi.org/10.5065/j0e4-ss70 The Software Engineering Assembly (SEA) is a loosely structured group of software engineers and scientists who write scientific software, mostly but not only at NCAR and mostly but not only in the field of atmospheric sciences. The mission ... CISL Affiliations: CISLAODEPT, HPCD, CSG, TDD, ASAP Publication Genre: Technical Report View on OpenSky |
Rejoinder on 'saving storage in climate ensembles: A model-based stochastic approach' Huang, H., Castruccio, S., Baker, A., Genton, M. G.. (2023). Rejoinder on 'saving storage in climate ensembles: A model-based stochastic approach'. Journal of Agricultural, Biological and Environmental Statistics, doi:https://doi.org/10.1007/s13253-023-00542-5 We thank all the discussants for their valuable comments. Throughout this rejoinder, we denote the discussants by D = Datta, P = Poppick, BA = Banerjee, BU = Burr, BUD = Bessac, Underwood and Di. We will also use the same acronyms as in the... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Saving storage in climate ensembles: A model-based stochastic approach Huang, H., Castruccio, S., Baker, A., Genton, M. G.. (2023). Saving storage in climate ensembles: A model-based stochastic approach. Journal of Agricultural, Biological and Environmental Statistics, doi:https://doi.org/10.1007/s13253-022-00518-x While climate models are an invaluable tool for increasing our understanding and therefore, the predictability of the Earth's system for decades, their increase in complexity and resolution has put a considerable, growing strain on the comp... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Sun, J., Dennis, J. M., Mickelson, S., Vanderwende, B., Gettelman, A., et al. (2023). Acceleration of the Parameterization of Unified Microphysics Across Scales (PUMAS) on the Graphics Processing Unit (GPU) With Directive-based methods. Journal of Advances in Modeling Earth Systems, doi:https://doi.org/10.1029/2022MS003515 Cloud microphysics is one of the most time-consuming components in a climate model. In this study, we port the cloud microphysics parameterization in the Community Atmosphere Model (CAM), known as Parameterization of Unified Microphysics Ac... CISL Affiliations: TDD, ASAP, HPCD, CSG Publication Genre: Article View on OpenSky |
Gettelman, A., Morrison, H., Eidhammer, T., Thayer-Calder, K., Sun, J., et al. (2023). Importance of ice nucleation and precipitation on climate with the Parameterization of Unified Microphysics Across Scales version 1 (PUMASv1). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-16-1735-2023 Cloud microphysics is critical for weather and climate prediction. In this work, we document updates and corrections to the cloud microphysical scheme used in the Community Earth System Model (CESM) and other models. These updates include a... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Enabling efficient execution of a variational data assimilation application Dennis, J. M., Baker, A., Dobbins, B., Bell, M. M., Sun, J., et al. (2023). Enabling efficient execution of a variational data assimilation application. The International Journal of High Performance Computing Applications, doi:https://doi.org/10.1177/10943420221119801 Remote sensing observational instruments are critical for better understanding and predicting severe weather. Observational data from such instruments, such as Doppler radar data, for example, are often processed for assimilation into numer... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Zhang, S., Zhang, K., Wan, H., Sun, J.. (2022). Further improvement and evaluation of nudging in the E3SM Atmosphere Model version 1 (EAMv1): simulations of the mean climate, weather events, and anthropogenic aerosol effects. Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-15-6787-2022 A previous study on the use of nudging in E3SM Atmosphere Model version 1 (EAMv1) had an unresolved issue; i.e., a simulation nudged to EAMv1's own meteorology showed non-negligible deviations from the free-running baseline simulation over ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Proceedings of the 2022 Improving Scientific Software Conference Hu, W., Vanderwende, B., Mickelson, S., Nusbaumer, J., Acharya, N., et al. (2022). Proceedings of the 2022 Improving Scientific Software Conference. , doi:https://doi.org/10.5065/98kd-b491 The Software Engineering Assembly (SEA) is a loosely structured group of software engineers and scientists who write scientific software, mostly but not only at NCAR and mostly but not only in the field of atmospheric sciences. The mission ... CISL Affiliations: HPCD, HPCDSEC, CSG, TDD, ASAP, CISLAODEPT Publication Genre: Technical Report View on OpenSky |
Zhang, K., Zhang, W., Wan, H., Rasch, P. J., Ghan, S. J., et al. (2022). Effective radiative forcing of anthropogenic aerosols in E3SM version 1: Historical changes, causality, decomposition, and parameterization sensitivities. Atmospheric Chemistry and Physics, doi:https://doi.org/10.5194/acp-22-9129-2022 The effective radiative forcing of anthropogenic aerosols (ERFaer) is an important measure of the anthropogenic aerosol effects simulated by a global climate model. Here we analyze ERFaer simulated by the E3SM version 1 (E3SMv1) atmospheric... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Yang, C. A., Diao, M., Gettelman, A., Zhang, K., Sun, J., et al. (2021). Ice and supercooled liquid water distributions over the southern ocean based on in situ observations and climate model simulations. Journal of Geophysical Research: Atmospheres, doi:https://doi.org/10.1029/2021JD036045 Three climate models are evaluated using in situ airborne observations from the Southern Ocean Clouds, Radiation, Aerosol Transport Experimental Study (SOCRATES) campaign. The evaluation targets cloud phases, microphysical properties, therm... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
On preserving scientific integrity for climate model data in the HPC era Baker, A.. (2021). On preserving scientific integrity for climate model data in the HPC era. Computing in Science & Engineering, doi:https://doi.org/10.1109/MCSE.2021.3119509 Over the last 30 years, the Computational Science Graduate Fellowship (CSGF) program has played an integral role in preparing a large and diverse community of computational scientists to push the limits of high-performance computing (HPC). ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Bahaveolos, C., Petropavlovskikh, I., Effertz, P., Duda, J., Mickelson, S., et al. (2021). Influence of transported anthropogenic pollution on regional tropospheric ozone using NOAA aircraft measurements. , doi:https://doi.org/10.5065/re5m-kj89 Anthropogenic pollution can travel long distances through the troposphere to impact the air quality of communities, regions, and countries downwind of emissions sources. In this study, carbon monoxide (CO)— a tracer of anthropogenic emiss... CISL Affiliations: TDD, ASAP Publication Genre: Manuscript View on OpenSky |
A scalable and efficient workflow for compressing high-resolution Earth system model data Xu, H., Loft, R. D., Paul, K., Banihirwe, A.. (2021). A scalable and efficient workflow for compressing high-resolution Earth system model data. CISL Affiliations: TDD, ASAP, CISLAODEPT, VAST Publication Genre: Conference Material View on OpenSky |
An overview of GPU enablement activities in STP and ASAP Dennis, J. M., Suresh, S. M., Brown, C., Dobbins, B., Baker, A., et al. (2021). An overview of GPU enablement activities in STP and ASAP. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Chang, P., Zhang, S., Danabasoglu, G., Yeager, S., Fu, H., et al. (2020). An unprecedented set of high-resolution earth system simulations for understanding multiscale interactions in climate variability and change. Journal of Advances in Modeling Earth Systems, doi:https://doi.org/10.1029/2020MS002298 We present an unprecedented set of high-resolution climate simulations, consisting of a 500-year pre-industrial control simulation and a 250-year historical and future climate simulation from 1850 to 2100. A high-resolution configuration of... CISL Affiliations: TDD, IOWA, ASAP Publication Genre: Article View on OpenSky |
Mickelson, S., Bertini, A., Strand, W. G., Paul, K., Nienhouse, E. J., et al. (2020). A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-13-5567-2020 The complexity of each Coupled Model Intercomparison Project grows with every new generation. The Phase 5 effort saw a dramatic increase in the number of experiments that were performed and the number of variables that were requested compar... CISL Affiliations: TDD, IOWA, ISD, SAGE, ASAP Publication Genre: Article View on OpenSky |
Pangeo benchmarking analysis: Object storage vs. POSIX file system Xu, H., Paul, K., Banihirwe, A.. (2020). Pangeo benchmarking analysis: Object storage vs. POSIX file system. CISL Affiliations: TDD, ASAP, VAST Publication Genre: Conference Material View on OpenSky |
Transforming an observational assimilation application on CPU and GPU Dennis, J. M., Dobbins, B., Baker, A., Kim, Y.. (2020). Transforming an observational assimilation application on CPU and GPU. CISL Affiliations: TDD, ASAP, IOWA Publication Genre: Conference Material View on OpenSky |
The Community Earth System Model Version 2 (CESM2) Danabasoglu, G., Lamarque, J., Bacmeister, J., Bailey, D. A., DuVivier, A. K., et al. (2020). The Community Earth System Model Version 2 (CESM2). Journal of Advances in Modeling Earth Systems, doi:https://doi.org/10.1029/2019MS001916 An overview of the Community Earth System Model Version 2 (CESM2) is provided, including a discussion of the challenges encountered during its development and how they were addressed. In addition, an evaluation of a pair of CESM2 long prein... CISL Affiliations: TDD, ASAP, IOWA, ISD, SAGE Publication Genre: Article View on OpenSky |
Optimizing the HOMME dynamical core for multicore platforms Dennis, J. M., Dobbins, B., Kerr, C. L., Kim, Y.. (2019). Optimizing the HOMME dynamical core for multicore platforms. The International Journal of High Performance Computing Applications, doi:https://doi.org/10.1177/1094342019849618 The approach of the next-generation computing platforms offers a tremendous opportunity to advance the state-of-the-art in global atmospheric dynamical models. We detail our incremental approach to utilize this emerging technology by enhanc... CISL Affiliations: TDD, ASAP, IOWA Publication Genre: Article View on OpenSky |
Experience with mixed-precision within physics parameterizations Dennis, J. M., Milroy, D., Baker, A., Gettelman, A., Hammerling, D.. (2019). Experience with mixed-precision within physics parameterizations. CISL Affiliations: TDD, ASAP, CISLVISITORS, IOWA Publication Genre: Conference Material View on OpenSky |
Using cloud-friendly data format in Earth system models applications Xu, H., Dennis, J. M.. (2019). Using cloud-friendly data format in Earth system models applications. CISL Affiliations: TDD, IOWA, ASAP Publication Genre: Conference Material View on OpenSky |
I/O performance with compression enabled Xu, H., Dennis, J. M.. (2019). I/O performance with compression enabled. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Reduced precision microphysics parameterizations in CAM Dennis, J. M., Milroy, D., Gettelman, A., Baker, A.. (2019). Reduced precision microphysics parameterizations in CAM. CISL Affiliations: TDD, ASAP, CISLVISITORS, IOWA Publication Genre: Conference Material View on OpenSky |
Evaluating the performance of the NEC Vector Engine and Cavium Thunder X2 on NCAR kernels Dennis, J. M., Dobbins, B., Kim, Y.. (2018). Evaluating the performance of the NEC Vector Engine and Cavium Thunder X2 on NCAR kernels. CISL Affiliations: TDD, ASAP, IOWA Publication Genre: Conference Material View on OpenSky |
A new workflow for CESM to address CMIP6 challenges Mickelson, S.. (2018). A new workflow for CESM to address CMIP6 challenges. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
Statistical Analysis of Compressed Climate Data Nardi, J., Feldman, N., Poppick, A., Baker, A., Hammerling, D.. (2018). Statistical Analysis of Compressed Climate Data. , doi:https://doi.org/10.5065/D6HQ3XQJ [Note: this Technical Note was updated on 2020-08-17 per the authors' request to correct an error. See the description of the change on page two of the document's front matter.] The data storage burden resulting from large climate model exp... CISL Affiliations: TDD, ASAP, IOWAG, SDSS Publication Genre: Technical Report View on OpenSky |
Using machine learning to simplify the identification of code optimization Uppala, R. K., Dennis, J. M., Kim, Y.. (2018). Using machine learning to simplify the identification of code optimization. Many of the scientific applications that execute on large scale parallel computing platforms run in a suboptimal fashion. Frequently, modest changes or optimizations to the internal calculation of the applications can significantly reduce t... CISL Affiliations: TDD, OSG, ASAP Publication Genre: Conference Material View on OpenSky |
Baker, A., Hammerling, D., Xu, H., Dennis, J. M., Clyne, J. P., et al. (2018). Lossy data compression for climate simulation data: Reducing data volume while preserving information. CISL Affiliations: TDD, ASAP, IOWAG, AIML, VAST Publication Genre: Conference Material View on OpenSky |
Lauritzen, P. H., Nair, R., Herrington, A. R., Callaghan, P., Goldhaber, S., et al. (2018). NCAR release of CAM-SE in CESM2.0: A reformulation of the spectral element dynamical core in dry-mass vertical coordinates with comprehensive treatment of condensates and energy. Journal of Advances in Modeling Earth Systems, doi:https://doi.org/10.1029/2017MS001257 It is the purpose of this paper to provide a comprehensive documentation of the new NCAR (National Center for Atmospheric Research) version of the spectral element (SE) dynamical core as part of the Community Earth System Model (CESM2.0) re... CISL Affiliations: CMG, TDD, ASAP Publication Genre: Article View on OpenSky |
CICE and POP2 boundary-exchange performance optimization Kim, Y., Dennis, J. M.. (2018). CICE and POP2 boundary-exchange performance optimization. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Code optimization and the accumulated impact on scientific throughput of an HPC center Dennis, J. M., Kelly, R., Edwards, J., Dobbins, B., Kerr, C. L., et al. (2018). Code optimization and the accumulated impact on scientific throughput of an HPC center. CISL Affiliations: TDD, ASAP, OSD, USS, CSG, STP, IOWAG Publication Genre: Conference Material View on OpenSky |
Milroy, D. J., Baker, A., Hammerling, D., Jessup, E. R.. (2018). Nine time steps: Ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-11-697-2018 The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. This objective test provides a statistical measurement of consistency b... CISL Affiliations: TDD, ASAP, IOWAG, AIML Publication Genre: Article View on OpenSky |
The accumulated impact of code optimizations on scientific throughput of CESM on Cheyenne Dennis, J. M., Kelly, R., Edwards, J., Dobbins, B., Kerr, C. L., et al. (2018). The accumulated impact of code optimizations on scientific throughput of CESM on Cheyenne. CISL Affiliations: TDD, ASAP, OSD, USS, CSG, STP, IOWAG Publication Genre: Conference Material View on OpenSky |
The accumulated impact of code optimizations on scientific throughput of CESM on Cheyenne Dennis, J. M., Kelly, R., Edwards, J., Dobbins, B., Kerr, C. L., et al. (2018). The accumulated impact of code optimizations on scientific throughput of CESM on Cheyenne. CISL Affiliations: TDD, ASAP, OSD, USS, CSG, STP, IOWAG Publication Genre: Conference Material View on OpenSky |
Using parallel Python tools to postprocess data for CMIP6 Mickelson, S., Paul, K.. (2018). Using parallel Python tools to postprocess data for CMIP6. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
Fortran Kernel Generator(KGen) and other NCAR tools Kim, Y., Dennis, J. M., Baker, A., Paul, K., Mickelson, S.. (2018). Fortran Kernel Generator(KGen) and other NCAR tools. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
KGen: A Python tool for automated Fortran kernel generation and verification Kim, Y., Dennis, J. M.. (2017). KGen: A Python tool for automated Fortran kernel generation and verification. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Progress with lossy compression of data from the Community Earth System Model (IN11B-258407 AGU'17) Xu, H., Baker, A., Li, S., Hammerling, D., Clyne, J. P.. (2017). Progress with lossy compression of data from the Community Earth System Model (IN11B-258407 AGU'17). CISL Affiliations: TDD, ASAP, IOWAG, AIML, VAST Publication Genre: Conference Material View on OpenSky |
Quality assurance and error identification for the Community Earth System Model Baker, A., Milroy, D., Hammerling, D., Xu, H.. (2017). Quality assurance and error identification for the Community Earth System Model. CISL Affiliations: TDD, ASAP, IOWAG, AIML Publication Genre: Conference Material View on OpenSky |
Preparing the Community Earth System Model for Exascale Computing Dennis, J. M., Kerr, C. L., Baker, A., Dobbins, B., Paul, K., et al. (2017). Preparing the Community Earth System Model for Exascale Computing. Exascale Scientific Applications: Scalability and Performance Portability Understanding the complex interactions present in the Earth's physical and biological systems within the ocean, atmosphere, land, and ice has long been of scientific interest. Recently, with the advent of accelerated climate change, the nee... CISL Affiliations: TDD, ASAP, IOWAG, STP Publication Genre: Chapter View on OpenSky |
Quality assurance and error identification for the Community Earth System Model Baker, A., Milroy, D. J., Hammerling, D., Xu, H.. (2017). Quality assurance and error identification for the Community Earth System Model. Proceedings of the First International Workshop on Software Correctness for HPC Applications, doi:https://doi.org/10.1145/3145344.3145491 Earth system models are valuable tools for furthering our understanding of past, present, and future climate states. Because these models tend to be large and complex as well as in a state of near constant development, quality assurance (an... CISL Affiliations: TDD, ASAP, IOWAG, AIML Publication Genre: Chapter View on OpenSky |
An integrated tutorial on InfiniBand, verbs, and MPI MacArthur, P., Liu, Q., Russell, R. D., Mizero, F., Veeraraghavan, M., et al. (2017). An integrated tutorial on InfiniBand, verbs, and MPI. IEEE Communications Surveys & Tutorials, doi:https://doi.org/10.1109/COMST.2017.2746083 This tutorial presents the details of the interconnection network utilized in many high performance computing (HPC) systems today. "InfiniBand" is the hardware interconnect utilized by over 35% of the top 500 supercomputers in the world as ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
KGen update & performance optimization of a long-wave radiation code Kim, Y.. (2017). KGen update & performance optimization of a long-wave radiation code. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Assessing representativeness of kernels using descriptive statistics Kim, Y., Dennis, J. M.. (2017). Assessing representativeness of kernels using descriptive statistics. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
How to use Cylc to run a CESM simulation Mickelson, S.. (2017). How to use Cylc to run a CESM simulation. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
Creevey, O. L., Metcalfe, T. S., Schultheis, M., Salabert, D., Bazot, M., et al. (2017). Characterizing solar-type stars from full-length Kepler data sets using the Asteroseismic Modeling Portal. Astronomy & Astrophysics, doi:https://doi.org/10.1051/0004-6361/201629496 The Kepler space telescope yielded unprecedented data for the study of solar-like oscillations in other stars. The large samples of multi-year observations posed an enormous data analysis challenge that has only recently been surmounted. As... CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Article View on OpenSky |
A new parallel python tool for the standardization of earth system model data Paul, K., Mickelson, S., Dennis, J. M.. (2017). A new parallel python tool for the standardization of earth system model data. IEEE International Conference on Big Data 2016, doi:https://doi.org/10.1109/BigData.2016.7840946 We have developed a new parallel Python tool for the standardization of Earth System Model (ESM) data for publication as part of Model Intercomparison Projects (MIPs). It was specifically designed to aid Community Earth System Model (CESM) ... CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Article View on OpenSky |
Toward a multi-method approach: Lossy data compression for climate simulation data Baker, A., Xu, H., Hammerling, D., Li, S., Clyne, J. P., et al. (2017). Toward a multi-method approach: Lossy data compression for climate simulation data. High Performance Computing. ISC High Performance 2017, doi:https://doi.org/10.1007/978-3-319-67630-2_3 Earth System Model (ESM) simulations are increasingly constrained by the amount of data that they generate rather than by computational resources. The use of lossy data compression on model output can reduce storage costs and data transmiss... CISL Affiliations: TDD, ASAP, IOWAG, AIML, VAST Publication Genre: Chapter View on OpenSky |
Evaluating lossy data compression on climate simulation data within a large ensemble Baker, A., Hammerling, D., Mickelson, S., Xu, H., Stolpe, M. B., et al. (2016). Evaluating lossy data compression on climate simulation data within a large ensemble. Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-9-4381-2016 High-resolution Earth system model simulations generate enormous data volumes, and retaining the data from these simulations often strains institutional storage resources. Further, these exceedingly large storage requirements negatively imp... CISL Affiliations: TDD, ASAP, IOWAG, SDSS Publication Genre: Article View on OpenSky |
Book review of "Python Programming and Visualization for Scientists," by Alex DeCaria Mickelson, S.. (2016). Book review of "Python Programming and Visualization for Scientists," by Alex DeCaria. Bulletin of the American Meteorological Society A book review of Alex DeCaria's Python Programming and Visualization for Scientists. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Article View on OpenSky |
Huang, X., Tang, Q., Tseng, Y., Hu, Y., Baker, A., et al. (2016). P-CSI v1.0, an accelerated barotropic solver for the high-resolution ocean model component in the Community Earth System Model v2.0. Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-9-4209-2016 In the Community Earth System Model (CESM), the ocean model is computationally expensive for high-resolution grids and is often the least scalable component for high-resolution production experiments. The major bottleneck is that the barotr... CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Article View on OpenSky |
Evaluating and optimizing the NERSC workload on Knight's Landing Barnes, T., Cook, B., Deslippe, J., Doerfler, D., Friesen, B., et al. (2016). Evaluating and optimizing the NERSC workload on Knight's Landing. NERSC [1] is the production HPC facility for the U.S. DOE Office of Science. The center supports over 6000 users with more than 600 unique applications in a wide variety of science domains. HPC systems deployed at NERSC must support a diver... CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Mickelson, S.. (2016). CMIP6 Workflow [presentation]. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
Dennis, J. M., Dobbins, B., Kerr, C. L., Kim, Y., Kumar, R. R. P., et al. (2016). Increasing thread parallelism within the High Order Methods Modeling Environment (HOMME) [presentation]. CISL Affiliations: TDD, ASAP, STP, IOWAG Publication Genre: Conference Material View on OpenSky |
Application of KGen and KGen-kernel [presentation] Kim, Y., Dennis, J. M.. (2016). Application of KGen and KGen-kernel [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
A dynamic congestion management system for InfiniBand networks Mizero, F., Veeraraghavan, M., Liu, Q., Russell, R. D., Dennis, J. M.. (2016). A dynamic congestion management system for InfiniBand networks. Supercomputing Frontiers and Innovations, doi:https://doi.org/10.14529/jsfi160201 While the InfiniBand link-by-link flow control helps avoid packet loss, it unfortunately causes the effects of congestion to spread through a network. Flows whose paths do not even pass through congested ports could suffer from reduced thro... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Jamroz, B. F., Klöfkorn, R.. (2016). Asynchronous communication in spectral-element and discontinuous Galerkin methods for atmospheric dynamics – a case study using the High-Order Methods Modeling Environment (HOMME-homme_dg_branch). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-9-2881-2016 The scalability of computational applications on current and next-generation supercomputers is increasingly limited by the cost of inter-process communication. We implement non-blocking asynchronous communication in the High-Order Methods M... CISL Affiliations: TDD, ASAP, CMG Publication Genre: Article View on OpenSky |
Baker, A., Hu, Y., Hammerling, D., Tseng, Y., Xu, H., et al. (2016). Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-9-2391-2016 The Parallel Ocean Program (POP), the ocean model component of the Community Earth System Model (CESM), is widely used in climate research. Most current work in CESM-POP focuses on improving the model's efficiency or accuracy, such as impro... CISL Affiliations: TDD, ASAP, GSP Publication Genre: Article View on OpenSky |
Milroy, D. J., Baker, A., Hammerling, D., Dennis, J. M., Mickelson, S., et al. (2016). Towards characterizing the variability of statistically consistent Community Earth System Model simulations. Procedia Computer Science, doi:https://doi.org/10.1016/j.procs.2016.05.489 Large, complex codes such as earth system models are in a constant state of development, requiring frequent software quality assurance. The recently developed Community Earth System Model (CESM) Ensemble Consistency Test (CESM-ECT) provides... CISL Affiliations: TDD, ASAP, GSP, IOWAG Publication Genre: Article View on OpenSky |
KGEN: A Python tool for automated Fortran kernel generation and verification Kim, Y., Dennis, J. M., Kerr, C. A., Kumar, R. R. P., Simha, A., et al. (2016). KGEN: A Python tool for automated Fortran kernel generation and verification. Procedia Computer Science, doi:https://doi.org/10.1016/j.procs.2016.05.466 Computational kernels, which are small pieces of software that selectively capture the characteristics of larger applications, have been used successfully for decades. Kernels allow for the testing of a compiler's ability to optimize code, ... CISL Affiliations: TDD, ASAP, STP, IOWAG Publication Genre: Article View on OpenSky |
Customizing compression for CESM data [poster] Xu, H., Baker, A., Hammerling, D., Li, S., Clyne, J. P.. (2016). Customizing compression for CESM data [poster]. CISL Affiliations: TDD, ASAP, IOWAG, GSP, OSD, HSS, DASG Publication Genre: Conference Material View on OpenSky |
Update on many-core optimizations of CESM Dennis, J. M., Kerr, C. L., Kim, Y., Kumar, R. R. P., Mickelson, S.. (2016). Update on many-core optimizations of CESM. CISL Affiliations: TDD, ASAP, STP, IOWAG Publication Genre: Conference Material View on OpenSky |
Mickelson, S.. (2016). CMIP6 Workflow [presentation]. CISL Affiliations: TDD, ASAP, IOWAG Publication Genre: Conference Material View on OpenSky |
Minimal aggregated shared memory messaging on distributed memory supercomputers Jamroz, B. F., Dennis, J. M.. (2016). Minimal aggregated shared memory messaging on distributed memory supercomputers. Many high-performance distributed memory applications rely on point-to-point messaging using the Message Passing Interface (MPI). Due to the latency of the network, and other costs, this communication can limit the scalability of an applica... CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
KGEN: A divide-and-conquer approach for Fortran application modernization [poster] Kim, Y., Dennis, J. M., Baker, A., Kumar, R. R. P., Mickelson, S.. (2016). KGEN: A divide-and-conquer approach for Fortran application modernization [poster]. CISL Affiliations: TDD, ASAP, IOWAG, STP Publication Genre: Conference Material View on OpenSky |
Simple ways to increase the performance of your Python code [presentation] Mickelson, S.. (2016). Simple ways to increase the performance of your Python code [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Simple task parallelism with Python [presentation] Mickelson, S.. (2016). Simple task parallelism with Python [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Improving the scalability of the ocean barotropic solver in the Community Earth System Model Hu, Y., Huang, X., Baker, A., Tseng, Y., Bryan, F. O., et al. (2016). Improving the scalability of the ocean barotropic solver in the Community Earth System Model. SC15: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, doi:https://doi.org/10.1145/2807591.2807596 High-resolution climate simulations are increasingly in demand and require tremendous computing resources. In the Community Earth SystemModel (CESM), the Parallel Ocean Model (POP) is computationally expensive for high-resolution grids (e.g... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Light-weight parallel Python tools for earth system modeling workflows Paul, K., Mickelson, S., Dennis, J. M., Xu, H., Brown, D.. (2015). Light-weight parallel Python tools for earth system modeling workflows. In the last 30 years, earth system modeling has become increasingly data-intensive. The Community Earth System Model (CESM) response to the next Intergovernmental Panel on Climate Change (IPCC) assessment report (AR6) may require close to 1... CISL Affiliations: TDD, ASAP, IOWAG, DVAT Publication Genre: Conference Material View on OpenSky |
Implementation of PFC and RCM for RoCEv2 simulation in OMNeT++ Lu, Q., Russell, R. D., Mizero, F., Veeraraghavan, M., Dennis, J. M., et al. (2015). Implementation of PFC and RCM for RoCEv2 simulation in OMNeT++. Proceedings of the 2nd OMNeT++ Community Summit As traffic patterns and network topologies become more and more complicated in current enterprise data centers and TOP500 supercomputers, the probability of network congestion increases. If no countermeasures are taken, network congestion c... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Many-core optimization of the Community Earth System Model [presentation] Dennis, J. M., Kerr, C. L., Kim, Y., Kumar, R. R. P., Oak, R., et al. (2015). Many-core optimization of the Community Earth System Model [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
KGEN: Fortran Kernel Generator [presentation] Kim, Y., Dennis, J. M., Kumar, R. R. P., Simha, A.. (2015). KGEN: Fortran Kernel Generator [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
An ensemble-based consistency test for the Community Earth System Model Baker, A., Hammerling, D., Levy, M. N., Xu, H., Dennis, J. M., et al. (2015). An ensemble-based consistency test for the Community Earth System Model. CISL Affiliations: TDD, ASAP, IOWAG, GSP, OSD, ESS, SWEG Publication Genre: Conference Material View on OpenSky |
CESM CMIP6 data workflow [presentation] Mickelson, S.. (2015). CESM CMIP6 data workflow [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0) Baker, A., Hammerling, D., Levy, M. N., Xu, H., Dennis, J. M., et al. (2015). A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0). Geoscientific Model Development, doi:https://doi.org/10.5194/gmd-8-2829-2015 Climate simulation codes, such as the Community Earth System Model (CESM), are especially complex and continually evolving. Their ongoing state of development requires frequent software verification in the form of quality assurance to both ... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
WebSLAM: A science gateway to a Simulation Library of Astrophysical galaxy cluster Mergers [poster] Chatzikos, M., Middleton, D. E., Nienhouse, E. J., Hook, N. C., Xu, H.. (2015). WebSLAM: A science gateway to a Simulation Library of Astrophysical galaxy cluster Mergers [poster]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Asteroseismic Modeling Portal (AMP) development [poster] Metcalfe, T., Xu, H., Middleton, D. E.. (2015). Asteroseismic Modeling Portal (AMP) development [poster]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Asteroseismic Modeling Portal (AMP) development [presentation] Metcalfe, T., Xu, H., Middleton, D. E.. (2015). Asteroseismic Modeling Portal (AMP) development [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Performance search engine driven by prior knowledge of optimization Kim, Y., Černý, P., Dennis, J. M.. (2015). Performance search engine driven by prior knowledge of optimization. ARRAY 2015: Proceedings of the 2nd ACM SIGPLAN International Workshop on Libraries, Languages, and Compilers for Array Programming, doi:https://doi.org/10.1145/2774959.2774963 For scientific array-based programs, optimization for a particular target platform is a hard problem. There are many optimization techniques such as (semantics-preserving) source code transformations, compiler directives, environment variab... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Optimizing CESM for many-core [presentation] Dennis, J. M., Kerr, C. L., Kim, Y., Kumar, R. R. P., Simha, A.. (2015). Optimizing CESM for many-core [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Optimizing workflow for CESM [presentation] Mickelson, S.. (2015). Optimizing workflow for CESM [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Jamroz, B. F., Klöfkorn, R.. (2015). Asynchronous Communication in Spectral Element and Discontinuous Galerkin Methods for Atmospheric Dynamics. , doi:https://doi.org/10.5065/D6Z60M3G The scalability of computational applications on current and next generation supercomputers is increasingly limited by the cost of inter-process communication. We implement non-blocking asynchronous communication in the High-Order Methods M... CISL Affiliations: TDD, ASAP Publication Genre: Technical Report View on OpenSky |
Light-weight parallel Python tools within the CESM workflow [presentation] Mickelson, S., Bertini, A.. (2015). Light-weight parallel Python tools within the CESM workflow [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
KGEN: Fortran Kernel Generator [presentation] Kim, Y., Dennis, J. M., Kumar, R. R. P., Simha, A.. (2015). KGEN: Fortran Kernel Generator [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
CESM Workflow Refactor Project Mickelson, S., Bertini, A.. (2015). CESM Workflow Refactor Project. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
CESM workflow plans [presentation] Mickelson, S., Bertini, A.. (2015). CESM workflow plans [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
CESM Workflow Refactor Project [presentation] Mickelson, S., Bertini, A.. (2015). CESM Workflow Refactor Project [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
CESM and POP workflow [presentation] Mickelson, S., Bertini, A.. (2015). CESM and POP workflow [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Fostering sound scientific practices within NCAR's software engineering community [presentation] Vento, D. D., Vadlamani, S., Jubera, J. A., Nagle, D.. (2015). Fostering sound scientific practices within NCAR's software engineering community [presentation]. The Software Engineering Assembly (SEA) is a group open to any UCAR employee engaged in software engineering or programming. The SEA exists to facilitate UCAR's mission by fostering effective software engineering practices, supporting profe... CISL Affiliations: OSD, HSS, CSG, TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Yellowstone: A dedicated resource for Earth System Science Loft, R. D., Vetter, J., Andersen, A. H., Bryan, F. O., Dennis, J. M., et al. (2015). Yellowstone: A dedicated resource for Earth System Science. Contemporary High Performance Computing: From Petascale toward Exascale, Volume Two CISL Affiliations: TDD, OSD, ASAP, HSS Publication Genre: Chapter View on OpenSky |
Light-weight parallel python tools for climate model workflows [poster] Mickelson, S., Paul, K., Dennis, J. M., Strand, W. G.. (2014). Light-weight parallel python tools for climate model workflows [poster]. It is expected that the data required for the next Intergovernmental Panel on Climate Change (IPCC) Assessment Report (AR6) will increase by more than a factor of 10 to an expected 25 terabytes per model. Experiences from the last Coupled M... CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Microscopic performance analysis of long-wave radiation physic on Xeon and XeonPhi [presentation] Kim, Y., Dennis, J. M.. (2014). Microscopic performance analysis of long-wave radiation physic on Xeon and XeonPhi [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Current status of CESM on Xeon Phi systems [presentation] Vadlamani, S., Dennis, J. M., Kim, Y., Edwards, J.. (2014). Current status of CESM on Xeon Phi systems [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Workflow tools for refactoring legacy code [presentation] Kim, Y., Vadlamani, S., Jamroz, B. F., Dennis, J. M.. (2014). Workflow tools for refactoring legacy code [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Accelerating the 'fields' package: Theory and computation of Kriging surfaces [presentation] Paige, J., Lyngaas, I., Vadlamani, S., Nychka, D.. (2014). Accelerating the 'fields' package: Theory and computation of Kriging surfaces [presentation]. 'Fields' is a widely used, open source, and freely available spatial statistics package in R that can be used to analyze spatial variation in anything from global temperatures to restaurant ratings. Increasingly, however, it has become nece... CISL Affiliations: CISLAODEPT, TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Accelerating the 'fields' package: Using parallel linear algebra software [presentation] Lyngaas, I., Paige, J., Vadlamani, S., Nychka, D.. (2014). Accelerating the 'fields' package: Using parallel linear algebra software [presentation]. Statistical packages such as the 'Fields' package in R can benefit from using multicore systems and accelerated hardware such as GPUs and Xeon Phis. Performance of linear algebra operations such as those used in spatial statistics computati... CISL Affiliations: CISLAODEPT, TDD, ASAP Publication Genre: Conference Material View on OpenSky |
HOMME trace analysis [presentation] Mizero, F., Dennis, J. M., Veeraraghavan, M., Russell, R., Liu, Q.. (2014). HOMME trace analysis [presentation]. The High-Order Method Modeling Environment (HOMME) is the default dynamical core within CAM, and consumes a significant fraction of the total cycles on Yellowstone. While HOMME has an scalable communication library that has been shown to sc... CISL Affiliations: CISLAODEPT, TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Using PyNIO and MPI for Python to help solve a big data problem for climate modellers [presentation] Brown, D., Dennis, J. M., Paul, K., Mickelson, S., Huang, W.. (2014). Using PyNIO and MPI for Python to help solve a big data problem for climate modellers [presentation]. CISL Affiliations: TDD, VETS, ASAP Publication Genre: Conference Material View on OpenSky |
Efforts of Xeon Phi use for CESM [presentation] Vadlamani, S., Kim, Y., Dennis, J. M., Levy, M. N., Edwards, J.. (2014). Efforts of Xeon Phi use for CESM [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Current efforts for performance analysis and enhancements of CESM [poster] Vadlamani, S., Dennis, J. M., Kim, Y., Edwards, J.. (2014). Current efforts for performance analysis and enhancements of CESM [poster]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
CESM workflow refactoring [presentation] Mickelson, S., Paul, K., Dennis, J. M., Bertini, A., Xu, H., et al. (2014). CESM workflow refactoring [presentation]. CISL Affiliations: TDD, ASAP, VETS Publication Genre: Conference Material View on OpenSky |
Overview of activities of the Application Scalability and Performance (ASAP) group [presentation] Dennis, J. M.. (2014). Overview of activities of the Application Scalability and Performance (ASAP) group [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
PyReshaper: A parallel Python tool for NetCDF time-slice to time-series conversion [poster] Paul, K., Dennis, J. M., Xu, H., Mickelson, S., Vertenstein, M., et al. (2014). PyReshaper: A parallel Python tool for NetCDF time-slice to time-series conversion [poster]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
A methodology for evaluating the impact of data compression on climate simultion data [presentation] Dennis, J. M., Baker, A.. (2014). A methodology for evaluating the impact of data compression on climate simultion data [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Redesigning the Community Earth System Model (CESM) workflow [presentation] Dennis, J. M., Mickelson, S., Baker, A., Paul, K.. (2014). Redesigning the Community Earth System Model (CESM) workflow [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |
Post-processing analysis of climate simulation data using Python and MPI [presentation] Dennis, J. M., Brown, D., Paul, K., Mickelson, S.. (2014). Post-processing analysis of climate simulation data using Python and MPI [presentation]. Advances in software parallelism and high-performance systems have resulted in an order of magnitude increase in the volume of output data produced by the Community Earth System Model (CESM). While the volume of data produced by CESM has in... CISL Affiliations: TDD, ASAP, VETS Publication Genre: Conference Material View on OpenSky |
Compact cell-centered discretization stencils at fine-coarse block structured grid interfaces Pletzer, A., Jamroz, B. F., Crockett, R., Sides, S.. (2014). Compact cell-centered discretization stencils at fine-coarse block structured grid interfaces. Journal of Computational Physics, doi:https://doi.org/10.1016/j.jcp.2013.12.020 Different strategies for coupling fine-coarse grid patches are explored in the context of the adaptive mesh refinement (AMR) method. We show that applying linear interpolation to fill in the fine grid ghost values can produce a finite volum... CISL Affiliations: TDD, ASAP Publication Genre: Article View on OpenSky |
Data compression of climate simulation data [presentation] Dennis, J. M., Baker, A.. (2013). Data compression of climate simulation data [presentation]. CISL Affiliations: TDD, ASAP Publication Genre: Conference Material View on OpenSky |