PhD position in Uncertainty quantification and handling of large language models
Deadline: 09.03.2025
Publisert
Simula Research Laboratory AS is a publicly owned research lab located in Oslo, Norway. Simula conducts Information and Communication Technology (ICT) research in the fields of scientific computing, software engineering, communication systems, machine learning and cybersecurity.
Simula's main objective is to create knowledge about fundamental scientific challenges that are of genuine value to society. This is achieved through high-quality research, education of graduate students, industry collaboration, technology transfer, and commercialization. Since 2001, scientific evaluations conducted by the Research Council of Norway have repeatedly placed Simula at the forefront of international research in ICT. The most recent in-depth evaluation was published in 2017, grading our full range of research as excellent.
Simula appreciates diversity. We currently employ approximately 200 individuals from 35 countries and strive to create a family-friendly working environment. We are an equal-opportunity employer and encourage women to apply.
Simula has a close collaboration with leading universities in Norway and abroad, both in terms of research and education and facilitates extended research stays abroad. Our Master's and PhD students conduct their research at Simula and attend courses and receive their degrees from university partners.
Norway is famous for its epic outdoor scenery, with wonderful fjords, gorgeous waterfalls and majestic mountain ranges. Moreover, Norway is a safe and peaceful country with a thriving economy, offering a high standard of living and all the benefits of a social-democratic welfare state, such as social security and universal public healthcare.
PhD position in Uncertainty quantification and handling of large language models for ACPS quality engineering tasks
Simula: solving problems, making a difference. Simula’s mission is to solve fundamental problems of science and engineering, with the main goal of improving society. We do this by concentrating on five select research areas in ICT and performing excellent research, developing our people, and spinning out applicable results into profitable startups. Learn more about: working at Simula and careers at Simula
Project/Job description
In the Department of Engineering Complex Software Systems (ComplexSE), we are now seeking candidates for a 3-year PhD position in the Innoguard MSCA Doctoral Network Project.
The main goal of the Innoguard project is to develop novel techniques, as well as methodological principles for the exploitation of AI methods such as deep learning, evolutionary algorithms, reinforcement learning, and large language models engineering, in the context of a peculiar activity of ACPS development, i.e., quality assurance.
Innoguard is coordinated by Mondragon University (Spain). Simula is partner, along with Universita degli Studi del Sannio (Italy), Oslo Metropilitan University (Norway), Vrije Universiteit Amsterdam (Netherlands), University of Malaga (Spain) and Zurcher Hochschule Fur Angewandte Wissenschaften (Switzerland).
The available position at Simula is for the Innoguard PhD project 5: Uncertainty quantification and handling of large language models for ACPS quality engineering tasks, where the project objectives are:
Investigating existing metrics to quantify and estimate uncertainty in LLMs such as single-inference and multi-inference and assessing their strengths and weakness in our context;
Devising novel metrics for uncertainty quantification and estimated based on identified weaknesses in the first objective;
Devising novel methods to use quantified uncertainty for risk assessment of the use of LLMs for ACPS quality engineering tasks to assess their trustworthiness,
Studying relationships of uncertainty with correctness and other non-functional characteristics (e.g., performance) of quantum engineering artifacts produced by LLMs such as test cases.
Innoguard PhD project 4 is also open, where the PhD candidate will be hosted by Oslo Metropolitan University.
Required Qualifications: Bachelor degree and master's degree in computer science or related study.
Candidate Profile: We are looking for interested candidates who have their Bachelor degree and master's degree in computer science or related study.
Simula Offers excellent opportunities for performing high-quality research, as part of a highly competent and motivated team of international researchers and engineers;
An informal and inclusive international working environment.
Generous support for travel and opportunities to build international networks, through established collaboration with industry, exchange programs and research visits with other universities, and funding to attend conferences.
Modern office facilities located in downtown Oslo.
Numerous benefits: access to company cabin, sponsored social events, generous equipment budgets (e.g., computer, phone and subscription), subsidized canteen meals, comprehensive travel/health insurance policy, etc.
Relocation assistance: accommodation, visas, complimentary Norwegian language courses, etc.
Administrative research support: e.g., quality assurance process for grant proposals (including RCN and EU programs).
Wellness and work-life balance. Our employees’ health and well-being is a priority and we encourage them to make use of our flexible work arrangements to help balance their work and home lives efficiently.
Application Requirements
Interested applicants are requested to submit the following:
Check your elegibility for the position. Carefully check the document in this link
Prepare your CV, cover letter, and academic transcripts. The cover letter should explain which is your motivation for the selected PhD topic and why you are a good fit to InnoGuard.
Submit your application via the Innoguard online application portal.
After submission, shortlisted candidates will be contacted for an interview.
Apply
IMPORTANT:
Applications should be submitted directly to the Innoguard application portal (instead of the standard Simula application link found at the top of this portal): Please read the instructions for applying for a PhD position in Innoguard, and apply here.
Application deadline 10 March 2025.
Note that all applications will be evaluated on a rolling basis.
Contacts
Additional enquiries regarding the position can be addressed to:
Simula Research Laboratory uses background checks in our recruitment process.
According to the Norwegian Freedom and Information Act (Offentleglova) information about the applicant may be included in the public applicant list, also in cases where the applicant has requested non-disclosure.
