AWS DATA ENGINEER
karachi
full time
hybrid
Job Responsibilities
- Design, build, & maintain scalable data pipelines on AWS using services such as Amazon S3, Glue, & EMR.
- Develop & optimize ETL processes to ingest data from various sources into our data lake & data warehouse.
- Collaborate with data scientists & analysts to understand data requirements & implement solutions for data transformation, aggregation, & analysis.
- Ensure data quality & integrity by implementing data validation & monitoring processes.
- Optimize performance of data infrastructure & pipelines for efficiency & cost-effectiveness.
- Implement security best practices to protect sensitive data & ensure compliance with regulations such as GDPR & HIPAA.
- Document design decisions, workflows, & operational procedures to maintain a knowledge base for the team.
- Stay up to date with the latest AWS technologies & industry trends to continuously improve our data infrastructure.
Skills
- Proven experience (3+ years) as a Data Engineer, with a focus on AWS cloud technologies, and experience and knowledge on Microsoft Azure technology is a plus.
- Extensive hands-on experience with AWS services such as Amazon Redshift, Amazon EMR, Amazon Kinesis, AWS Glue, etc
- Strong understanding of data modeling, ETL processes, data warehousing, and data governance principles.
- Familiarity with programming/scripting languages like Python, SQL, and experience with data manipulation and transformation.
- Excellent problem-solving skills with the ability to design and implement creative solutions for complex data challenges.
- Knowledge of data governance and compliance standards.
- Strong communication skills to effectively collaborate with technical and non-technical teams.
- Experience in working with Agile methodologies and version control systems.
- Proven ability to work independently and manage multiple priorities effectively.
Education & Certification
- Bachelors or associate degree in IT discipline
- Certification in AWS Certified: Solution Architect Associate or AWS Certified: Data Engineer is an added advantage.
