Model adaptation
LoRA Fine-Tuning with Hugging Face
Explore LoRA fine-tuning for Llama models using Hugging Face Transformers and your own data.
A small sample of 30,000+ courses curated from around the world, all available to DoJo members.
A free 30-minute conversation with Ted about your goals.
Already a member? Open this course (opens in a new tab)
Course topics
Model adaptation
- Model and dataset
- LoRA training
- Before-and-after inference
You compare the outputs
Find your fit
Is this a useful starting point?
For learners with basic Python and machine-learning knowledge and a Google Colab account.
- Starting point
- Intermediate
- Course length
- 0.5 total hours
- Lessons
- 6 lectures
Course by Machine Learning Warrior
Course last updated: 04/2024
Requirements
- Basic Python knowledge
- Basic machine learning knowledge
- A Google Colab account
What is included
- 32 mins on-demand video
- 1 downloadable resource
- Access on mobile
- Certificate of completion
DoJo membership: A$250 per month per seat, excluding GST. Includes fortnightly group support and a private member community.
Explore the lessons
Course curriculum.
LoRA Fine Tuning6 lectures • 32min
- Introduction / Installation06:02
- Model / Dataset Creation04:28
- Inference of Pretrained Model03:30
- Training with LoRA11:05
- Inference of Trained Model04:20
- Extra Explanation of LoRA Paper03:04
From learning to practice
Try this next.
Compare a model's output before and after the LoRA training exercise.
A useful next step
Choose where to start.
Talk through your goals in a free 30-minute discovery call with Ted. Bring a task you want to improve and the tools you already use.
Book a discovery callExplore DoJo membership