[Crib-list] SPEAKER: William Moses (MIT) | CRIBB Seminar | Fri., Dec. 3, 2021 | 12:00 pm - 1:00 PM -- via "ZOOM" (fwd)

[Shirley Entzminger]

 	A   R E M I N D E R ...



VIRTUAL EVENT...


 	 COMPUTATIONAL RESEARCH in BOSTON and BEYOND SEMINAR
 				 (CRIBB)


ZOOM Link:
 		https://mit.zoom.us/j/96155042770

 		Meeting ID: 961 5504 2770


===================================================


DATE:	Friday, December 3, 2021

TIME:	12:00 PM - 1:00 PM


TITLE:	Enzyme: High-Performance, Cross-Language,
 	 and Parallel Automatic Differentiation


SPEAKER:   WILLIAM MOSES  (MIT)


ABSTRACT:

Automatic differentiation (AD) is key to training neural networks, Bayesian 
inference, and scientific computing. Applying these techniques requires 
rewriting code in a specific machine learning framework or manually providing 
derivatives. This talk presents Enzyme, a high-performance automatic 
differentiation compiler plugin for the low-level virtual machine (LLVM) 
compiler capable of synthesizing gradients of programs expressed in the LLVM 
intermediate representation (IR). Enzyme differentiates programs in any 
language whose compiler targets LLVM, including C/C++, Fortran, Julia, Rust, 
Swift, etc., thereby providing native AD capabilities in these languages with 
state-of-the-art performance. Unlike traditional tools, Enzyme performs AD on 
optimized IR. On a combined machine-learning and scientific computing benchmark 
suite, AD on optimized IR achieves a geometric mean speedup of 4.5x over AD on 
IR before optimization.

This talk will also include work that makes Enzyme the first fully automatic 
reverse-mode AD tool to generate gradients of existing GPU kernels. This 
includes new GPU and AD-specific compiler optimizations, and an algorithm 
ensuring correctness of high-performance parallel gradient computations. We 
provide a detailed evaluation of five GPU-based HPC
applications, executed on NVIDIA and AMD GPUs.


=============================================

Massachusetts Institute of Technology
Cambridge, MA

============================================

For information about the "Computational Research in Boston and Beyond Seminar" 
(CRIB), please visit:

 		 https://math.mit.edu/crib/


ZOOM information listed at the beginning of this email, on the attached poster 
and also on the CRIB Website.

==============


Please let me know if you have any questions.

===
Shirley A. Entzminger
Administrative Assistant II
Department of Mathematics
Massachusetts Institute of Technology
77 Massachusetts Avenue
Building 2, Room 350A
Cambridge, MA 02139
PHONE: 	(617) 253-4994
E-mail:	daisymae at math.mit.edu
-------------- next part --------------
A non-text attachment was scrubbed...
Name: CRIBB Seminar - William Moses - (MIT) - Friday, December 3, 2021 - Virtual.pdf
Type: application/pdf
Size: 192673 bytes
Desc: 
URL: <http://mailman.mit.edu/pipermail/crib-list/attachments/20211202/0f2a6d99/attachment.pdf>