Roles & Responsibilities
- Develop, test, and maintain data pipelines using Databricks, PySpark, and Python.
- Ingest, transform, and process structured and semi-structured data from multiple sources.
- Support the development of scalable ETL/ELT workflows for analytics, reporting, and machine learning use cases.
- Work with data engineers, analysts, and data scientists to understand data requirements and deliver reliable datasets.
- Perform data cleansing, validation, and quality checks to ensure accuracy and consistency.
- Optimize Spark jobs and Databricks notebooks for performance, reliability, and cost efficiency.
- Create and maintain documentation for data pipelines, workflows, data definitions, and processes.
- Assist in troubleshooting pipeline failures, data issues, and performance bottlenecks.
- Follow best practices for version control, code quality, testing, and deployment.
- Support basic AI/ML data preparation activities, including feature engineering, dataset creation, and model input preparation.




- Monitor scheduled jobs and workflows to ensure timely and successful data delivery.
- Collaborate with cross-functional teams in an Agile or iterative development setting.

Basic Qualifications And Experience
- 2-6 years of experience with Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, Mathematics, or a related field, or equivalent practical experience

Must-Have Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, Mathematics, or a related field, or equivalent practical experience.
- Hands-on experience with Python for data processing, scripting, and automation.
- Strong working knowledge of PySpark and distributed data processing concepts.
- Proven hands-on experience using Databricks for data engineering, including notebooks, clusters, jobs, workflows, Delta tables, and performance optimization.
- Ability to build, maintain, and troubleshoot scalable

📌 Associate Data Engineer (Hyderabad)
🏢 AMGEN
📍 Hyderabad