Internship : Large Language Model fine tuning
Inria
Montbonnot-Saint-Martin, 38330
Internship : Large Language Model fine tuning
Le descriptif de l’offre ci-dessous est en Anglais
Type de contrat : Stage
Niveau de diplôme exigé : Bac + 3 ou équivalent
Fonction : Stagiaire de la recherche
A propos du centre ou de la direction fonctionnelle
The Centre Inria de l’Université de Grenoble groups together almost 600 people in 22 research teams and 7 research support departments.
Staff is present on three campuses in Grenoble, in close collaboration with other research and higher education institutions (Université Grenoble Alpes, CNRS, CEA, INRAE, …), but also with key economic players in the area.
The Centre Inria de l’Université Grenoble Alpe is active in the fields of high-performance computing, verification and embedded systems, modeling of the environment at multiple levels, and data science and artificial intelligence. The center is a top-level scientific institute with an extensive network of international collaborations in Europe and the rest of the world.
Contexte et atouts du poste
Are you passionate about working with state-of-the-art language models like GPT-3, customizing the language model to master specific topics and excel in certain tasks? This internship offers an exciting opportunity to contribute to our research and development efforts by studying and fine-tuning large language models. You will work closely with our team of AI experts to explore the capabilities of these models and adapt them for real-world applications.
Mission confiée
- Conduct a state-of-the-art review of LLMs, fine tuning techniques and evaluation metrics.
- Run experiments on Inria’s computer cluster.
- Analyze and interpret data to identify areas for improvement and propose innovative solutions.
Principales activités
Observe, learn, think, act
Compétences
- Currently pursuing a M1 or master's (M2) degree in computer science, electrical engineering, robotics, or a related field.
- Good programming skills in Python, C++ or similar.
- Familiarity with machine learning, language models, and tools such as PyTorch.
- Solid understanding of mathematics, especially linear algebra and statistics.
- Strong problem-solving skills and the ability to work both independently and in a collaborative team environment.
Avantages
- Subsidized meals
- Partial reimbursement of public transport costs
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
- Professional equipment available (videoconferencing, loan of computer equipment, etc.)
- Social, cultural and sports events and activities
- Access to vocational training
- Social security coverage under conditions
Rémunération
Gratification = 4,05€ gross / hour