Loading…
← Back to schedule
PRO SESSION (Dev Innovation): Creating Your Own LLM from Opensource Models
Wednesday November 6, 2024 9:30am - 9:55am PST
Dev Innovation Summit -- Main Stage
Sebastiano Galazzo, Seynapsia AI, Artificial intelligence researcher

From a "simple" finetuning to your own Mixture of Expert model using opensource models.
Nowadays training from scratch an LLM is a so huge effort also for very big company. Starting from pre-trained models to create your own model is no more a way for resourceless companies, but a often a must starting point.

- Lora
- Quantization and QLora
- Injecting embeddings model into Lora to manage multiple Lora adapters.
- Mixing models
- Creating your MoE (Mixture of experts) model using several finetuned (Your own) models
Speakers
avatar for Sebastiano Galazzo

Sebastiano Galazzo

Artificial intelligence researcher, Seynapsia AI
Winner of three AI awards, I’ve been working in AI and machine learning for 25 years, designing and developing AI and computer graphic algorithms.I’m very passionate about AI, focusing on Audio, Image and Natural Language Processing, and predictive analysis as well.I received... Read More →
Wednesday November 6, 2024 9:30am - 9:55am PST
Dev Innovation Summit -- Main Stage
  Dev Innovation Summit, Developer Tools
Feedback form is now closed.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link