Thesis: Learning Task-Relevant Latent Spaces for Sim-to-Real Transfer

SICK AG

Job

In this thesis, you will develop methods to evaluate synthetic datasets based on task-relevant information and work on improving sim-to-real transfer in industrial computer vision.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • Would you like to explore a fundamental research question at the intersection of representation learning, synthetic data, and industrial computer vision? In this thesis, you will investigate how to determine whether a synthetic dataset contains the information needed to train a model for use in real-world applications.
  • Common dataset comparison metrics primarily measure visual or statistical similarities. However, they do not necessarily capture whether the shared information is relevant to a specific task, such as object detection. Existing methods for assessing transferability also often assume that a suitable pretrained representation is already available. This is not always the case, particularly in specialized industrial applications.
  • The goal of this thesis is to learn and evaluate latent representations that allow synthetic and real-world datasets to be compared based on their task-relevant information.
  • Investigate supervised and self-supervised approaches to learning task-aware representations from labeled synthetic data and unlabeled or partially labeled real-world data.
  • Develop distance metrics in latent space to compare datasets and evaluate how well these metrics predict downstream model performance in real-world applications.
  • Compare your approach with established methods, analyze its limitations, and implement a prototype for evaluating synthetic datasets.
  • Validate your findings experimentally and investigate the underlying assumptions and potential failure cases.
  • Document your findings and derive recommendations for using and selectively improving synthetic datasets in industrial AI development.
  • The outcome of your thesis will be a validated methodology and a functional prototype for task-aware synthetic data assessment, together with a critical analysis of the underlying assumptions, limitations, and potential failure cases. Your findings could help improve the selection, reuse, and refinement of synthetic datasets.

Our expectations of you

Education

  • Currently pursuing an advanced master's degree in Computer Science, Artificial Intelligence, Data Science, Mathematics, Robotics, Physics, Engineering, or a related field.

Qualifications

  • Knowledge of representation learning, self-supervised learning, or synthetic data is an advantage.
  • Ability to understand scientific literature, formulate hypotheses, design controlled experiments, and critically evaluate results.
  • Ability to quickly grasp complex technical problems and work independently and systematically.
  • Ability to communicate findings clearly and collaborate with an interdisciplinary team.
  • Strong interest in representation learning, synthetic data, sim-to-real transfer, and applied industrial AI research.
  • Good written and spoken English skills.

Experience

  • Good knowledge of machine learning and deep learning, with practical experience in computer vision and neural networks.
  • Good Python programming skills and practical experience with PyTorch or a comparable deep learning framework.

What we offer

  • Summer Semester 2027 - fixed term of 3-6 months.

Benefits

Higher take-home pay

Food & drink

Health, fitness & fun

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Waldkirch
    79183 Baden-Württemberg, Germany

About your employer

We are one of the leading manufacturers of sensors and sensor solutions for industrial automation. Our innovative technology allows us to offer individual solutions that are tailored precisely to your needs. This is how we ensure that you always achieve the best possible performance.

Company size
250+ Employees
Company type
Established Company
Work model
Onsite, Hybrid, Full Remote
Industry
Industry, Production

Employer reviews

3.6Total(1 review)
Career growth
x
3.6
Working conditions
x
4.4
Team culture
x
3.8
Engineering
x
2.8
  • GGW GroupHamburg

    • Easy Apply
    • Hybrid
    • Full Time

    The role As a Forward Deployed AI Engineer, you go directly into our specialist departments, understand the processes, and develop production-ready AI and automation solutions that will fundamentally change the way the entire GGW Group operates. You do...

  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Full Time

    Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...

    • Java
    • Spring Boot
    • Apache Kafka
  • Öko-Institut Consult gGmbHFreiburg im Breisgau, Berlin

    • Easy Apply
    • Hybrid
    • Onsite
    • Part Time/Full Time

    Operation, monitoring, and further development of the network infrastructure. Administration and configuration of firewalls, routers, and switches. Ensuring network availability, performance, and security. Participation in IT security concepts and...

    • TCP/IP
    • Active Directory
    • Windows
    • Microsoft Exchange
    • Office 365
    • Linux
    • VLAN
    • +4

Thesis: Learning Task-Relevant Latent Spaces for Sim-to-Real Transfer

SICK AG