Responsibilities
:
1. Design and implement effective data models and table structures across various storage systems, including relational databases, NoSQL stores, data warehouses, and data lakes.
2. Build, maintain, and optimize robust data pipelines (ETL/ELT) to ingest, transform, and load data from production systems and external sources.
3. Use workflow orchestration tools to schedule, automate, and monitor data pipelines, ensuring their reliability and performance.
4. Define and implement data quality standards and processes (e.g., bronze, silver, gold tiering), including handling missing values and ensuring data integrity, accuracy, and completeness.
5. Establish and enforce data governance policies and procedures, manage data lineage and metadata, implement access controls and encryption, and support compliance with data privacy regulations (e.g., GDPR, CCPA).
6. Implement and manage scalable data platforms (data warehouses, data lakes) to support efficient analytics, feature engineering, and model training for AI applications.
7. Conduct statistical analyses and evaluations of datasets, and develop dashboards or monitoring systems to track pipeline health and data quality metrics.
8. Collaborate closely with AI Engineers, AI Software Engineers, QA Engineers, and Data Analysts to understand data requirements and deliver reliable, high-quality data solutions.
Qualifications:
9. Proven experience as a Data Engineer, including designing and building data pipelines and infrastructure.
10. Strong proficiency in SQL and Python for data manipulation, automation, and pipeline development.
11. Hands-on experience with cloud platforms (e.g., GCP, Azure) and their respective data services (e.g., BigQuery, Azure Data Factory, Databricks).
12. Familiarity with big data tools and frameworks such as Apache Spark, Kafka, or Hadoop.
13. Solid understanding of data modeling, ETL/ELT development, and data warehousing concepts.
14. Experience with data quality management and data governance principles.
15. Proficiency with version control systems (e.g., Git).
16. Excellent problem-solving skills and high attention to detail.
What we offer
17. An attractive compensation package above the collectively agreed minimum basic salary (according to the IT-KV, Regelstufe with classification ST1/rule: EUR 3.843 gross/month)
18. 28 days of well-deserved holidays
19. Onsite Onboarding in our HQ office for an optimal start
20. Great compensation and benefits packages including company achievement bonus and stock-based options, regular salary reviews
21. Public transport friendly office
22. Special terms for local gyms
23. Access to Corporate Benefits platform with many discounts
24. Regular Team events and company-wide celebrations
25. Open door policy, no dress code rules, frequent all Hands and Leadership Lunches
26. Hybrid and Flexible work time with up to 50% home office
27. Work From Abroad Program allowing up to 40 days of work outside your contracting country
28. We celebrate diversity as one of core values, join and drive one of the c-a-r-e initiatives together with us!