dreamwork_

Job Title: AWS EMR Engineer (Spark/PySpark, Python, Shell Scripting)

Key Responsibilities:

  • Design, develop, and optimize data processing workflows on AWS EMR using Spark/PySpark.

  • Write efficient Python and Shell scripts to automate data processing tasks.

  • Implement data processing solutions with large-scale datasets in a cloud environment.

  • Work closely with data teams to identify and address performance bottlenecks.

  • Troubleshoot and resolve issues in data pipelines and production environments.

  • Ensure the scalability, reliability, and efficiency of data solutions.

Required Skills:

  • Strong experience with AWS EMR and Apache Spark/PySpark.

  • Proficient in Python and Shell scripting for data pipeline automation.

  • Experience working with large-scale data processing and distributed systems.

  • Familiarity with AWS services such as S3, EC2, Glue, and Redshift.

  • Strong knowledge of data processing concepts, ETL processes, and performance optimization.

Required Skills : Amazon Web Services (AWS),Python

Basic Qualification :

Additional Skills :

Background Check : No

Drug Screen : No