From the course: Applied AI: Getting Started with Hugging Face Transformers
Join today to access over 23,200 courses taught by industry experts.
A language model
From the course: Applied AI: Getting Started with Hugging Face Transformers
A language model
- [Instructor] As we start to discuss pre-trained transformers, it is important to understand the concept of a language model. A language model is a machine learning model that represents a human language in a general or specific context, it understands words, meanings, word relationships, and sentence context. It can be used to predict the next word in a sentence based on a previous sequence or predict missing words in a sentence. A language model can also be built with a smaller context, specific to a domain like medicine or physics. What are some of the features of language models? Language models are built on a large corpus of data. Some models are built using Wikipedia or entire Twitter tweet data sets. Some of the corpora can be specific like a medical encyclopedia. Language models can be used to predict words based on previous words or fill in the blanks. It is also able to relate words with the same meaning.…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.