報告題目：Current Trends in Self-supervised Learning
報告時間：2022年7月16日上午9：30
2022年7月17日上午9：30
報告方式：騰訊會議
會議碼：994-2148-5209
報告人：許東 教授
報告人簡介：
Dong Xu is Curators’ Distinguished Professor in the Department of Electrical Engineering and Computer Science, with appointments in the Christopher S. Bond Life Sciences Center and the Informatics Institute at the University of Missouri-Columbia. He obtained his Ph.D. from the University of Illinois, Urbana-Champaign in 1995 and did two years of postdoctoral work at the US National Cancer Institute. He was a Staff Scientist at Oak Ridge National Laboratory until 2003 before joining the University of Missouri, where he served as Department Chair of Computer Science during 2007-2016 and Director of Information Technology Program during 2017-2020. Over the past 30 years, he has conducted research in many areas of computational biology and bioinformatics, including single-cell data analysis, protein structure prediction and modeling, protein post-translational modifications, protein localization prediction, computational systems biology, biological information systems, and bioinformatics applications in human, microbes, and plants. His research since 2012 has focused on the interface between bioinformatics and deep learning. He has published more than 400 papers with more than 21,000 citations and an H-index of 74, according to Google Scholar. He was elected to the rank of American Association for the Advancement of Science (AAAS) Fellow in 2015 and American Institute for Medical and Biological Engineering (AIMBE) Fellow in 2020.
報告内容簡介：
Self-supervised learning (SSL) has achieved impressive successes in recent years by leveraging vast amounts of unlabeled data and obtaining semantically meaningful representations. SSL adopts self-defined pseudo-labels as supervision and the learned representations often significantly improve the performance of downstream tasks. In this talk, I will review the three major SSL approaches, i.e., self-prediction, contrastive learning, and redundancy reduction, as well as related topics, such as data argumentation techniques and SSL design principles. I will provide details and comparisons about individual methods, including contrastive methods (PIRL, SimCLR, MoCo), clustering-based methods (DeepCluster, SwAV), distillation-based methods (BYOL, SimSiam), redundancy reduction (Barlow Twins, VICReg), and multi-modal learning (DCCA, CLIP). Finally, I will discuss why SSL works well, current challenges, potential pitfalls, and future directions.
主辦單位：伟德国际BETVlCTOR
伟德国际BETVlCTOR軟件學院
伟德国际BETVlCTOR計算機科學技術研究所
符号計算與知識工程教育部重點實驗室
仿真技術教育部重點實驗室
網絡技術及應用軟件教育部工程研究中心
伟德国际BETVlCTOR國家級計算機實驗教學示範中心
