Loading…
Cephalocon 2019 has ended
Barcelona, Spain
May 19-20, 2019
Click Here for More Information & Registration
Back To Schedule
Monday, May 20 • 11:00 - 11:40
Rapid Processing of NASA Satellite Data Stored with Ceph - Kevin Hrpcek & Steve Dutcher, University of Wisconsin Space Science and Engineering Center

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
The NASA VIIRS Atmosphere SIPS, located at the University of Wisconsin, is responsible for assisting the Science Team in algorithm development and production of VIIRS Level-2 Cloud and Aerosol products. To facilitate algorithm development, the SIPS requires access to multiple years of satellite data occupying petabytes of space. Being able to reprocess the entire mission and provide validation results back to the Science Team in a rapid fashion is critical for algorithm development. To accomplish this task the Atmosphere SIPS has deployed a six petabyte Ceph cluster employing numerous different components such as librados, EC-Pools, RBD, and CephFS. This talk will discuss choices we made to optimize the system allowing for rapid reprocessing of years of satellite data.
Speakers
SD

Steve Dutcher

Data Scientist, University of Wisconsin Space Science and Engineering Center
Steve Dutcher is a Data Scientist working at the University of Wisconsin-Madison. He graduated in 2000 with a B.S in computer science and began his career at University of Wisconsin, Space Science & Engineering Center. In the early years he worked on airborne instruments flying aboard... Read More →
avatar for Kevin Hrpcek

Kevin Hrpcek

Software Developer, University of Wisconsin - Madison
Kevin is a technology and science enthusiast who is a DevOps Engineer for the Space Science and Engineering Center at the University of Wisconsin - Madison. He joined SSEC in 2015 at the beginning of the NASA Atmosphere SIPS contract. Working with a small team of developers he has... Read More →

cephalocon 2019 ssec pdf
Monday May 20, 2019 11:00 - 11:40 BST
G2
  Track 2