You can gain access to a world of education through Stanford Online, the Stanford School of Engineering’s portal for academic and professional education offered by schools and units throughout Stanford University. https://online.stanford.edu/ Our robust catalog of degree programs, credit-bearing education, professional certificate programs, and free and open content is developed by Stanford faculty, enabling you to expand your knowledge, advance your career, and enhance your life. Stanford Online is operated and managed by the Stanford Engineering Center for Global & Online Education (CGOE). CGOE expands access to Stanford teaching and research, working in collaboration with faculty in the School of Engineering and throughout Stanford University to design and deliver extensive global, online, and enterprise education to a global audience.
This episode explores the evolution of large language models (LLMs) from pre-trained models to sophisticated conversational AI like ChatGPT. Against the backdrop of exponentially increasing computational power and training data (from billions to trillions of tokens), the lecture details how LLMs initially focused on n...
This episode explores the evaluation and advancement of neural machine translation (NMT) systems, focusing on the role of attention mechanisms. The discussion begins by outlining the limitations of traditional machine translation evaluation metrics, such as BLEU score, highlighting its inability to capture the nuances...
This episode explores the evolution and challenges of Recurrent Neural Networks (RNNs), specifically focusing on their application in language modeling and machine translation. Against the backdrop of limitations in traditional N-gram models, RNNs emerged as a promising architecture capable of handling sequential data...
This episode explores the evolution and inner workings of neural networks, specifically focusing on their application in language modeling. Against the backdrop of the historical challenges in training deep neural networks, the speaker delves into key advancements like improved regularization techniques (including dro...
This episode explores the linguistic structure of human language sentences and the methods for building dependency parsers. The speaker contrasts two primary approaches to analyzing sentence structure: phrase structure grammars (context-free grammars) and dependency grammars. More significantly, the lecture focuses o...
This episode explores the mathematical underpinnings of neural networks and the backpropagation algorithm. The speaker begins by reviewing the concept of neural networks as cascades of logistic regressions, emphasizing the self-organization of intermediate representations as a key to their power. Against this backdro...
This episode explores the intricacies of word vectors and their application in natural language processing (NLP). Against the backdrop of optimization basics using gradient descent and stochastic gradient descent, the speaker delves into Word2Vec and its variants, highlighting the surprising ability of these algorithm...
This episode explores the foundations and current methods of deep learning applied to natural language processing (NLP). Against the backdrop of the increasing popularity of large language models like ChatGPT, the speaker delves into the Word2vec algorithm, a decade-old yet highly successful method for learning vector...
The podcast explores AI agentic language models as a progression of language model usage, addressing common limitations and design patterns. It highlights strategies for prompt engineering, such as clear instructions, relevant context, and reasoning techniques like chain of thought. Retrieval augmented generation and t...
Follow this podcast in Podwise
Sign in to get AI summaries, transcripts and mind maps for any episode, including new ones.
