Cloud Big Data Engineer / DevOps Engineer

Qimia

Job

In this role, you will develop innovative data analytics solutions using modern technologies and create ETL pipelines for complex datasets on cloud platforms focusing on machine learning and big data.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • Development of innovative platforms and technologies, particularly in the areas of Data Analytics, Machine Learning, and Artificial Intelligence.
  • Development of recommendation engines, web and text data mining using Natural Language Understanding models, application of algorithms and tools for network and graph analysis, deep neural network learning.
  • End-to-End design and implementation of data analytics systems; this includes data collection, requirements engineering and specification, as well as the design of technical solutions based on business requirements.
  • Development of ETL pipelines for large complex datasets and processing of structured and unstructured data with Spark, Hive, Kafka, Flume, Oozie, etc.
  • Prototyping and implementation of massively scaled data analytics solutions based on Big Data tools (Hadoop, Spark, HIVE / Impala, SQL, H2O, Python, and R).
  • Working with cloud platforms (Amazon Web Services, Microsoft Azure, or Google Cloud Platform).
  • Development of event streaming solutions in a container-based environment.

Our expectations of you

Education

  • University degree in Computer Science, Information Systems, or an equivalent qualification in Computer Science, Statistics, Operations Research, Bioinformatics, Mathematics, or Physics.

Qualifications

  • Basic understanding of relational and non-relational databases.
  • Understanding of automation on AWS or Azure using deployment tools and/or other continuous integration/configuration management tools (e.g., Ansible and Terraform).
  • Solution-oriented approach and implementation of your solution for our clients.
  • Proactivity, team spirit, strong communication skills, resilience, and an independent, analytical, and conceptual working style characterize you.
  • The ability to explain complex technical structures and issues to clients or colleagues.
  • Excellent command of both German and English, spoken and written.
  • Mobility and flexibility to work on-site at the client's location are part of our job. We do our best to coordinate travel and on-site work or remote work from home in a way that suits you well.

Experience

  • Experience with AWS or Azure technology and practical experience in programming with AWS or Azure APIs.
  • Experience with one or more general-purpose programming languages, including but not limited to: Java, C / C++, Python, Scala, or JavaScript.

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Cologne
    Nordrhein-Westfalen, Germany
  • Location Hanover
    Niedersachsen, Germany

About your employer

Wir sind ein junges und dynamisches Inhabergeführtes IT Unternehmen. Wir unterstützen unsere Kunden durch die Realisierung maßgeschneiderter IT-Lösungen und verbinden dabei Bereiche wie Big Data Analytics, Business Intelligence und Data Warehousing, Cloud Services, Hadoop und Spark, Software Entwicklung in Scala, Python, Java Full Stack Development, Data Migration und gleichzeitig Projekt- und Prozessmanagement.

Company type
Established Company
Work model
Onsite, Hybrid
Industry
Internet, IT, Telecommunication
  • sinoDusseldorf

    • Easy Apply
    • Onsite
    • Full Time
    • Senior

    sino AG, based in downtown Düsseldorf, has been an innovative financial service provider for over 25 years. We specialize in the execution of securities transactions for the most active and demanding traders in Germany. With currently 26 employees, we...

    • Java
    • PHP
    • C#
    • SQL
    • Linux
    • Windows
  • GGW GroupHamburg

    • Easy Apply
    • Hybrid
    • Full Time

    The role As a Forward Deployed AI Engineer, you go directly into our specialist departments, understand the processes, and develop production-ready AI and automation solutions that will fundamentally change the way the entire GGW Group operates. You do...

  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Full Time

    Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...

    • Java
    • Spring Boot
    • Apache Kafka

Cloud Big Data Engineer / DevOps Engineer

Qimia