Cloud Data Engineer
Job Summary:
The Cloud Data Engineer will play a pivotal role in leveraging cloud
technologies to design, develop, and maintain robust data pipelines and
ecosystems. This position impacts critical business decisions by providing
accessible and scalable data solutions using AWS, Python, and various data
processing tools.
Key Responsibilities:
-
Design and implement ETL processes using AWS Glue and PySpark to transform
and load data into Redshift databases.
-
Develop and maintain data models, data architecture, and data warehouses to
support analytical needs.
-
Collaborate with data scientists and analysts to understand data
requirements and develop efficient data flows.
-
Optimize data pipelines for performance and scalability, ensuring data
quality and consistency.
-
Monitor and troubleshoot data integrations and workflows to ensure reliable
data availability.
-
Implement data security and compliance protocols within the cloud ecosystem.
-
Document data processes, architecture, and workflows for continuous
improvement and knowledge sharing.
Requirements:
-
Bachelor's degree in Computer Science, Information Technology, or a related
field.
-
Proven experience in cloud data engineering with a focus on AWS
technologies.
-
Strong proficiency in Python and experience with PySpark for data
processing.
- Hands-on experience with AWS Glue and Amazon Redshift.
- Knowledge of database management and data modeling concepts.
- Understanding of data warehousing concepts and best practices.
- Excellent problem-solving skills and a strong attention to detail.
Preferred Qualifications:
- Experience with data visualization tools such as Tableau or Power BI.
- Familiarity with other AWS services, such as S3, Kinesis, and Lambda.
- Knowledge of data governance and data privacy regulations.
-
Experience working in Agile environments and with version control systems
like Git.
-
Strong communication skills and the ability to work collaboratively in a
team.
Benefits:
- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance plans.
- Generous paid time off and flexible work schedules.
- Opportunities for professional development and certifications.
- Remote work options and a supportive work-from-home culture.
- Retirement savings plan with company matching.
- Access to wellness programs and employee assistance services.