[Crib-list] VIRTUAL Seminar...SPEAKER: Baolin Li (Northeastern University) / CRIBB Seminar / 12:00 PM - 1:00 PM / Friday, August 5, 2022 (fwd)

[Shirley Entzminger]

    VIRTUAL...

 	       COMPUTATIONAL RESEARCH in BOSTON and BEYOND SEMINAR
 				  (CRIBB)


   ZOOM meeting info...

 	https://mit.zoom.us/j/96155042770

 	Meeting ID: 961 5504 2770

====================================

DATE:	Friday, August 5, 2022

TIME:	12:00 PM - 1:00 PM


TITLE:	Leveraging Heterogeneous Hardware Resources for Efficient Machine
 	Learning Inference Service



SPEAKER:  BAOLIN LI  (Northeastern University)


ABSTRACT:

Machine learning (ML) model inference is a key service in many businesses and
scientific discovery processes. In the meantime, modern HPC systems and clouds
are integrating more and more heterogeneous resources into the system. In this
talk, I will discuss various techniques we develop to efficiently serve ML
inference workloads using heterogeneous hardware resources. I will first
introduce a simplified version of the inference serving problem, of which we
apply a integer linear programming solver to minimize the energy consumption.
Next, I will emphasize on a few challenges in a production environment where the
inference queries display high variety and the users demand strict
quality-of-service (QoS). To solve this complicated problem, we propose RIBBON,
a cost-effective and QoS-aware inference server deployed on heterogeneous cloud
computing instances. RIBBON formulates this as a black-box optimization problem
and devises a Bayesian Optimization-driven strategy to allocate the
heterogeneous resources. Compared to existing approaches, RIBBON saves up to 16%
of the inference serving cost on various representative workloads.


=======================================

For information about the "Computational Research in Boston and Beyond Seminar"
(CRIBB), please visit:

 		https://math.mit.edu/sites/crib/


=================

Shirley A. Entzminger
Administrative Assistant II
Department of Mathematics
Massachusetts Institute of Technology
77 Massachusetts Avenue
Building 2, Room 350A
Cambridge, MA 02139
PHONE: 	(617) 253-4994
E-mail:	daisymae at math.mit.edu
-------------- next part --------------
A non-text attachment was scrubbed...
Name: CRIBB Seminar -- Spk., Baolin Li (Northeastern Univ.) - August 5, 2022.pdf
Type: application/pdf
Size: 172051 bytes
Desc: 
URL: <http://mailman.mit.edu/pipermail/crib-list/attachments/20220804/1a5dc672/attachment.pdf>