Job Title: AWS EMR Engineer (Spark/PySpark, Python, Shell Scripting)
Key Responsibilities:
Design, develop, and optimize data processing workflows on AWS EMR using Spark/PySpark.
Write efficient Python and Shell scripts to automate data processing tasks.
Implement data processing solutions with large-scale datasets in a cloud environment.
Work closely with data teams to identify and address performance bottlenecks.
Troubleshoot and resolve issues in data pipelines and production environments.
Ensure the scalability, reliability, and efficiency of data solutions.
Required Skills:
Strong experience with AWS EMR and Apache Spark/PySpark.
Proficient in Python and Shell scripting for data pipeline automation.
Experience working with large-scale data processing and distributed systems.
Familiarity with AWS services such as S3, EC2, Glue, and Redshift.
Strong knowledge of data processing concepts, ETL processes, and performance optimization.
Required Skills : Amazon Web Services (AWS),Python
Basic Qualification :
Additional Skills :
Background Check : No
Drug Screen : No