[Crib-list] SPEAKER: William Moses (MIT) | CRIB Seminar | Fri., Dec. 3, 2021 | 12:00 pm - 1:00 PM -- via "ZOOM"

[Shirley Entzminger]

VIRTUAL EVENT...


 	COMPUTATIONAL RESEARCH in BOSTON and BEYOND SEMINAR
 				(CRIBB)


ZOOM Link:
   	    https://mit.zoom.us/j/96155042770

    	    Meeting ID: 961 5504 2770


===================================================


DATE:	Friday, December 3, 2021

TIME:	12:00 PM - 1:00 PM


TITLE:	Enzyme: High-Performance, Cross-Language,
 	and Parallel Automatic Differentiation


SPEAKER:   WILLIAM MOSES  (MIT)


ABSTRACT:

Automatic differentiation (AD) is key to training neural networks, 
Bayesian inference, and scientific computing. Applying these techniques 
requires rewriting code in a specific machine learning framework or 
manually providing derivatives. This talk presents Enzyme, a 
high-performance automatic differentiation compiler plugin for the 
low-level virtual machine (LLVM) compiler capable of synthesizing 
gradients of programs expressed in the LLVM intermediate representation 
(IR). Enzyme differentiates programs in any language whose compiler 
targets LLVM, including C/C++, Fortran, Julia, Rust, Swift, etc., thereby 
providing native AD capabilities in these languages with state-of-the-art 
performance. Unlike traditional tools, Enzyme performs AD on optimized IR. 
On a combined machine-learning and scientific computing benchmark suite, 
AD on optimized IR achieves a geometric mean speedup of 4.5x over AD on IR 
before optimization.

This talk will also include work that makes Enzyme the first fully 
automatic reverse-mode AD tool to generate gradients of existing GPU 
kernels. This includes new GPU and AD-specific compiler optimizations, and 
an algorithm ensuring correctness of high-performance parallel gradient 
computations. We provide a detailed evaluation of five GPU-based HPC
applications, executed on NVIDIA and AMD GPUs.


=============================================

Massachusetts Institute of Technology
Cambridge, MA

============================================

For information about the "Computational Research in Boston and Beyond Seminar" 
(CRIB), please visit:

 		 https://math.mit.edu/crib/


ZOOM information listed at the beginning of this email, on the attached poster 
and also on the CRIB Website.

==============


Please let me know if you have any questions.

===
Shirley A. Entzminger
Administrative Assistant II
Department of Mathematics
Massachusetts Institute of Technology
77 Massachusetts Avenue
Building 2, Room 350A
Cambridge, MA 02139
PHONE: 	(617) 253-4994
E-mail:	daisymae at math.mit.edu
-------------- next part --------------
A non-text attachment was scrubbed...
Name: CRIBB Seminar - William Moses - (MIT) - Friday, December 3, 2021 - Virtual.pdf
Type: application/pdf
Size: 192673 bytes
Desc: 
URL: <http://mailman.mit.edu/pipermail/crib-list/attachments/20211130/6117ed95/attachment.pdf>