Scott Wilkins: Highlights 2015
Data Stewardship / Access and Services Development, Information Technology
Support for NOAA Big Data Project
CICS-NC is providing technical and scientific support to help make data from NCEI available via several cloud-based services as part of NOAA’s Big Data Project. This project established a partnership between NOAA, Amazon Web Services, Google Cloud Platform, IBM, Microsoft, and the not-for-profit Open Cloud Consortium. The goals include providing the public and private sectors with unprecedented access to environmental data and positioning data in close proximity to cloud-based high-performance computing resources, which will expand opportunities for both research and economic development.
As part of this initiative, the entire Level 2 Next Generation Weather Radar (NEXRAD) archive from NOAA’s NCEI is being transferred to both the Amazon Web Services and Microsoft Azure platforms.
On October 27, 2015, Amazon Web Services became the first of the Big Data partners to make NEXRAD data available publicly via their website. The AWS platform provides users with seamless, single-API access to both historical and real-time NEXRAD data.
NEXRAD data is now available via Amazon Web Services.
Information Technology
Current Infrastructure
- High speed networking
- 802.11 AC WIFI
- Video Communications
- 10 Gigabit Ethernet
- High-performance computing
- 45 Nodes
- 528 Cores / 3.2TB RAM
- Virtual Machine Platform
- 6 Hosts, 72 Cores, 640GB RAM
- Over 30 virtualized systems
- Data services
- Over 1.2 PB on disk
- Over 2.25 PB on Tape
- 8 Gigabit Fiber Channel
