Ongoing Projects

[ICML 24] A novel framework for calculating GraB updates in a layer-wise fashion, integrating seamlessly into the PyTorch Automatic Differentiation (AD) engine that makes it possible to employ optimal convergence rates in the pre-training of Large Language Models (LLMs).

[GrAPL 2024 Workshop] A general framework for GPU scheduling and heterogeneous computation in distributed memory.

Generate novel molecules with desired properties using deep generative models from latent space and optimal transition-based sampling.

Prove the convergence of GraB under Adam optimizer, best if we can show it’s optimal.

[ICML 24] Generate novel molecules with desired properties using deep generative models from latent space and optimal transition-based sampling.

[NAACL 24] NoteAid is a BioNLP system that automatically recognizes medical concepts and translates medical jargon into patient-oriented lay language.