Position: Data Engineer- Databricks + AWS
Purpose of the Position:
Develop, support and steer end-to-end business intelligence using Databricks
Location: Nagpur/ Pune/ Bangalore/ Chennai
Key Responsibilities:
- Work with account/project architects to understand and translate requirements into technical implementations.
- Develop, implement, and maintain pyspark code through Databricks UI that enables data and analytics use cases for the client.
- Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
Work and Technical Experience:
Mandatory Skills:
- Overall 5+ and 3+ Hands on Experience with Databricks, PySpark and Python
- Thorough understanding of Databricks Unity Catalog, Notebook, Autoloader, Data apps, Genie and other key services/features
- Proficiency in SQL and data manipulation skills
- Understanding of data warehousing concepts and technologies.
Desirable Skills:
- Understanding of AWS platform and its key services like S3, Lambda etc.
- Familiarity with ETL processes and tools for data extraction, transformation, and loading.
- Familiarity with AI/BI dashboards in Databricks, Agentic workflows in Databricks.
Qualifications:
- Bachelor's degree in computer science, engineering, or related field.
- Demonstrated continued learning through one or more technical certifications or related methods.
- 5+ years of relevant experience in Data Engineering.
- Relevant experience in media domain.
Qualities:
- Self-motivated and focused on delivering outcomes for a fast-growing team and firm.
- Able to communicate persuasively through speaking, writing, and client presentations.
- Able to consult, write, and present persuasively.
- Able to work in a self-organized and cross-functional team.
- Able to iterate based on new information, peer reviews, and feedback.
- Able to work with teams and clients in different time zones.
- Research focused mindset.