High Throughput Computing in the Service of Scientific Discovery

Date & Time: 28/10/2019, 4:00 pm
Venue: Faculty Hall, Indian Institute of Science

For more than three decades we have been engaged in translating the potential of distributed computing into effective High Throughput Computing (HTC) software tools. The widely adopted HTCondor distributed resource and job management system that we have developed has facilitated evaluation of novel HTC frameworks and technologies under real-life workloads on production distributed systems. Embracing an experimental approach to our work led to close collaboration with researchers from a wide range of domains. These collaborations contributed to two Nobel prizes in recent years and were instrumental in advancing HTC technologies and practices. For example, the UW-Madison Center for High Throughput Computing delivered in the last 12 months close to 400M core hours to more than 250 projects. The talk will present the principles that have been guiding our work, review our experience in deploying HTCondor in different research computing settings, outline our short term development efforts and review long term HTC challenges.

Speaker Bio:
Miron Livny received a B.Sc. degree in Physics and Mathematics in 1975 from the Hebrew University and M.Sc. and Ph.D. degrees in Computer Science from the Weizmann Institute of Science in 1978 and 1984, respectively. Since 1983 he has been on the Computer Sciences Department faculty at the University of Wisconsin-Madison, where he is currently the John P. Morgridge Professor of Computer Science, the director of the Center for High Throughput Computing (CHTC), is leading the HTCondor project and serves as the principal investigator and technical director of the Open Science Grid (OSG). He is a member of the scientific leadership team of the Morgridge Institute of Research where he is leading the Software Assurance Market Place (SWAMP) project and is serving as the Chief Technology Officer of the Wisconsin Institutes of Discovery. Dr. Livny’s research focuses on distributed processing and data management systems and involves close collaboration with researchers from a wide spectrum of disciplines. He pioneered the area of High Throughput Computing (HTC) and developed frameworks and software tools that have been widely adopted by academic and commercial organizations around the world.

Scroll Up