DevOps/Data Engineer

Role: DevOps/Data Engineer

Location: Coopersburg, PA

Work Schedule: Hybrid (2, 3 days a week in office)

 

Job Description: We are seeking a hybrid DevOps + Data Engineering profile, with a stronger emphasis on DevOps capabilities. The role owner will be required to modify & manage ETL pipelines as part of platform operations. The role owner should have hands on DevOps experience along with good understanding of data pipelines.

Key Result Areas and Activities:

1. DevOps requirements

· Modify and manage data pipelines in DevOps setup

· Good understating of CI/CD pipelines

2. Development responsibilities

I. Software Asset Maintenance & Upgrades

· Upgrade and maintain third-party components such as ingress controllers, service meshes, monitoring agents, infrastructure libraries, and cloud-native tools.

· Apply the latest versions and security patches to ensure compliance, stability, and performance.

II. Infrastructure as Code (IaC) Enhancements

· Update and enhance IaC scripts to support version upgrades across development, QA, and production environments.

· Validate changes through sandbox testing before deployment to production.

III. Compatibility & Dependency Management

· Ensure upgraded components remain compatible with dependent services and applications.

· Identify and mitigate potential breaking changes or dependency conflicts.

IV. Application Code Adjustments

· Implement necessary code changes in supported languages (e.g., Python) to accommodate new versions or configuration requirements.

· Address minor and moderate changes required for compatibility with upgraded components.

· Update existing unit tests in response to the application code changes.

V. Security & Compliance

· Apply immediate fixes for vulnerabilities.

· Maintain adherence to organizational security and governance guidelines.

VI. Testing & Validation

· Create and execute test strategies for validating the upgrades.

· Execute existing unit tests and manual test cases post-upgrade.

· Conduct functional testing of impacted applications to ensure end-to-end stability.

· Validate application behaviour after code changes and infrastructure updates.

VII. Reporting & Governance

· Provide weekly status reports detailing software versions, security posture, upgrade activities, and testing outcomes.

· Participate in regular reviews and acceptance processes.

Work and Technical Experience:

Must-Have Skill Set:

· Terraform

· CI/CD Pipelines

· Platform upgrades and maintenance

· QA exposure – integration & platform testing

· Deep understanding of cloud data services (AWS) and migration strategies.

· Strong proficiency in ETL/ELT pipelines and framework development using Python. Development may not be needed but understanding is required

· Modifying & monitoring data pipelines for batch and real-time processing.

· Exceptional communication skills for engaging executives and non-technical stakeholders.

· Knowledge of containerization (Docker, Kubernetes) and orchestration for data workloads.

Good-to-Have Skill Set:

· Certifications in cloud platforms (AWS) and data engineering.

· Experience with advanced analytics and machine learning pipelines.

· Prior consulting experience or leading large-scale data transformation programs.

· Knowledge of data extraction from SAP OData Services.

· Experience with multiple relational and NoSQL databases (Must have - Redshift, RDS and Athena).

· Experience with BI tools integration with enterprise data platforms.

Qualification:

· Bachelor’s degree in computer science, engineering, or related field (master's degree is a plus)

· Demonstrated continued learning through one or more technical certifications or related methods

· At least 9+ years of relevant experience; two years may be substituted for a master’s degree