Job Description
Key Responsibilities
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
Job Tags
Similar Jobs
Sunbelt Staffing
...Description Job Description Seeking a dynamic Registered Nurse with school-based experience to provide exceptional healthcare services across... .... Key Qualifications & Skills: Active NJ School Nursing RN license required Strong background in school nursing; LPNs...
Burger and Brown Engineering
...Job Summary Our experienced CNC Swiss Lathe Programmer role will develop programs and setup plans of CNC swiss lathe turning centers, applying knowledge of machine shop theory and procedures, shop mathematics, machineability of materials, and layout techniques. Job Duties...
Fladger Associates
...Rate: Negotiable Salary: NA, $1.00 Responsibilities: Excellent employment opportunity for a Drug Safety Associate in the Stamford, CT area. Completion of remaining case data entry (including narrative or auto-narrative), manual coding...
American College of Physicians
...disability, contact this employer to ask for an accommodation or an alternative application process.SVP, Medical Education & Chief Learning OfficerFull Time Philadelphia, PA, US9 days ago Requisition ID: 1204American College of Physicians (ACP) invites applications...
Labcorp
...role, you will answer over 80 inbound calls daily, primarily assisting Spanish-speaking customers while ensuring satisfaction and resolving billing inquiries. The position offers a work-from-home option, a competitive pay rate between $17.75 - $21.00, and comprehensive...