Overview
Collibra Data Lineage Automation Engineer – are you looking for excitement, challenge and stability in your work? If you are a Collibra Data Lineage Automation Engineer, this page may be of interest as you explore opportunities with our IT Solutions Integrator/Consulting firm helping clients hire the right professionals for exciting, long-term projects.
We offer a disruptive talent solution to maximize earning and growth potential.
Responsibilities
* Lead the implementation of automated lineage across diverse systems.
* Cloud platforms (e.g., Snowflake, AWS).
* Legacy RDBMS and ETLs (e.g., SQL Server, Oracle).
* NoSQL databases (e.g., MongoDB).
* BI/reporting tools (e.g., Tableau, Power BI).
* Design and extend lineage capture frameworks (e.g., Spline, OpenLineage, Marquez) for enterprise-wide adoption.
* Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.
* Integrate lineage with metadata/governance platforms (Collibra, Alation) to ensure usability and traceability.
* Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).
* Develop reusable lineage components and promote automation-first, reusable design principles.
* Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices.
Required Skills & Experience
* Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).
* Hands-on experience with Spline, OpenLineage, Marquez, or similar open-source lineage frameworks.
* Deep knowledge of metadata capture, ETL tracing, and query execution mapping.
* Strong AI/ML background, with experience in:
o Metadata intelligence
o NLP-based code parsing
o Pattern detection in lineage gaps
* Programming expertise in Python, Scala, or Java.
* Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB, etc.
* Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).
Nice-to-Have / Big Plus Skills
* Hands-on experience with commercial lineage tools (evaluation or implementation).
* Background in regulated industries (finance, healthcare, insurance).
* Familiarity with event-driven architectures for real-time lineage propagation.
* Exposure to data mesh and domain-driven lineage approaches.
Ideal Candidate Profile
* Has successfully delivered automated lineage at enterprise scale.
* Operates at the intersection of data engineering, metadata management, and AI innovation.
* Acts as a strategic thought partner to architects, governance leads, and business stakeholders.
* Brings an automation-first, reusable component mindset to all lineage solutions.
Benefits: Visit us at Alignity Solutions is an Equal Opportunity Employer, M/F/V/D. The company welcomes applications from all qualified individuals.
Visit us at http://alignity.io/careers. CEO Message: Click Here. Clients Testimonial: Click Here.
#J-18808-Ljbffr