[Crib-list] VIRTUAL Seminar...SPEAKER: Baolin Li (Northeastern University) / CRIBB Seminar / 12:00 PM - 1:00 PM / Friday, August 5, 2022

[Shirley Entzminger]

    VIRTUAL...

 	       COMPUTATIONAL RESEARCH in BOSTON and BEYOND SEMINAR
 				  (CRIBB)


   ZOOM meeting info...

 	https://mit.zoom.us/j/96155042770

 	Meeting ID: 961 5504 2770

====================================

DATE:	Friday, August 5, 2022

TIME:	12:00 PM - 1:00 PM


TITLE:	Leveraging Heterogeneous Hardware Resources for Efficient Machine
 	Learning Inference Service



SPEAKER:  BAOLIN LI  (Northeastern University)


ABSTRACT:

Machine learning (ML) model inference is a key service in many businesses 
and scientific discovery processes. In the meantime, modern HPC systems 
and clouds are integrating more and more heterogeneous resources into the 
system. In this talk, I will discuss various techniques we develop to 
efficiently serve ML inference workloads using heterogeneous hardware 
resources. I will first introduce a simplified version of the inference 
serving problem, of which we apply a integer linear programming solver to 
minimize the energy consumption. Next, I will emphasize on a few 
challenges in a production environment where the inference queries display 
high variety and the users demand strict quality-of-service (QoS). To 
solve this complicated problem, we propose RIBBON, a cost-effective and 
QoS-aware inference server deployed on heterogeneous cloud computing 
instances. RIBBON formulates this as a black-box optimization problem and 
devises a Bayesian Optimization-driven strategy to allocate the 
heterogeneous resources. Compared to existing approaches, RIBBON saves up 
to 16% of the inference serving cost on various representative workloads.


=======================================

For information about the "Computational Research in Boston and Beyond Seminar"
(CRIBB), please visit:

 		https://math.mit.edu/sites/crib/


=================

Shirley A. Entzminger
Administrative Assistant II
Department of Mathematics
Massachusetts Institute of Technology
77 Massachusetts Avenue
Building 2, Room 350A
Cambridge, MA 02139
PHONE: 	(617) 253-4994
E-mail:	daisymae at math.mit.edu
-------------- next part --------------
A non-text attachment was scrubbed...
Name: CRIBB Seminar -- Spk., Baolin Li (Northeastern Univ.) - August 5, 2022.pdf
Type: application/pdf
Size: 172051 bytes
Desc: 
URL: <http://mailman.mit.edu/pipermail/crib-list/attachments/20220802/24896f16/attachment.pdf>