Caltech Library Workshop – Natural Language Processing with Transformer Models

Caltech Library is offering an introductory sequence of workshops on Machine Learning, Deep Learning, and Natural Language Processing. These workshops are designed for researchers in all areas with an interest in machine learning and language processing. 

The workshops are designed to be "hands on" and require some familiarity with basic Python programming and the Unix Shell, such as that provided through the Library's introductory workshops. Although concepts and skills are cumulative through the sequence of workshops, the workshops will be as free-standing as possible. The Deep Learning sequence will be the most inter-dependent. Recordings of workshops will be made available to registered participants.

Workshops will be online, on selected Tuesdays and Fridays at noon. There is one registration for all seven workshops. The Zoom link for all workshops will be included in the registration confirmation.

Part Three: Natural Language Processing

Workshops 6 and 7 will focus on Natural Language Processing, starting with classic NLP processing methods using NLTK and SpaCy, and closing with the application of neural networks to NLP, particularly the revolutionary Transformer architecture that powers Generative Artificial Intelligence.

Friday, May 24, 2024: NLP with Transformer Models

• • Topics: the evolution of Large Language Models, "Attention" and the Transformer architecture, using the Python Transformers package for NLP tasks