This project is already taken or is out of date.
Medior Data Engineer (Databricks / Azure, Treasury Data Warehouse)
Location Vienna
Experience Medior
We are looking for Medior Data Engineer to support a modernization of a Treasury Data Warehouse (TWH) environment, including migration from an MS-SQL-based operational DWH with SSAS/ROLAP cubes to Databricks/DBX on Azure. The engagement focuses on building data ingestion and ETL pipelines, converting existing logic to Spark/Databricks jobs, and supporting governance, validation, and business continuity for reporting in a hybrid setup across Vienna and Bratislava.
Key Responsibilities
* Design, develop, and migrate data ingestion and ETL pipelines from MS SQL Server / SSIS to Databricks (Spark) on Azure.
* Convert existing T‑SQL / Transact‑SQL logic into Spark/Databricks jobs (e.g., Python/SQL-based implementations) and optimize performance.
* Implement and maintain workflow orchestration / workflow management (e.g., Databricks Workflows and related orchestration approaches; ADF where applicable).
* Support definition and delivery of PoC/MVP scope, including functional and non‑functional requirements, acceptance criteria, and validation of migration/design options.
* Work with target architecture patterns such as Bronze/Silver/Gold layers and align engineering work with the target data model and TOM.
* Implement reconciliation checks and validation to compare SQL Server outputs vs Databricks outputs; contribute to data quality KPIs.
* Contribute to data governance and security implementation: data access policies, encryption, cataloging and lineage (e.g., Unity Catalog and lineage/validation tooling).
* Support business continuity for reporting by redesigning/adapting dependent assets such as reports, dashboards, cubes, and semantic models (e.g., Tableau, XLCubed, Power BI).
* Collaborate with stakeholders across delivery leadership, data engineering, governance, and business/domain analysis teams in Vienna and Bratislava; contribute to stakeholder communication and coordination.
Requirements
* Seniority: Medior.
* Strong hands‑on experience with Python and SQL, including Transact‑SQL.
* Experience with Apache Spark and Databricks/DBX (target platform on Azure preferred).
* Experience with Extract Transform Load (ETL) and migration/rewriting of pipelines.
* Experience with SQL Server Integration Services (SSIS); familiarity with SQL Server and DWH environments (including SSAS/ROLAP cubes context).
* Experience with workflow management / orchestration (e.g., Databricks workflows; ADF mentioned as relevant).
* Knowledge of governance and compliance topics relevant to data platforms, including GDPR and frameworks such as DAMA.
* Familiarity with cataloging/lineage and access control approaches (e.g., Unity Catalog).
* Technologies mentioned as relevant: ANTLR, data lineage/validation tools, Tableau, XLCubed, Power BI.
* Preferred: Treasury business know-how; prior experience with Erste Group (not mandatory, but preferred in the broader program context).
Other
* Work mode: Hybrid with 2 days on-site per week.
* Contract length: 6 months (possible extension: yes).
Platform/Tool Tableau Azure Data Factory databricks Unity catalog Azure Power BI SQL Server Analysis Services (SSAS) XLCubed SQL Server Integration Services (SSIS) Databricks Workflows
#J-18808-Ljbffr