04 Aug
|
O2 Breathing Brains
|
Mumbai
04 Aug
O2 Breathing Brains
Mumbai
Role - AWS Data / PySpark Developer
Location - Mumbai
Interview Mode: Virtual than F2F
Experience : 3-6 yrs
Job SummaryWe are looking for a skilled AWS Data / PySpark Developer with strong SQL expertise and hands-on experience in AWS cloud services, including S3 and EMR. The ideal candidate should be capable of working on large-scale data processing, data transformation, dashboard development, and performance optimization across BI and big data platforms.
Responsibilities :
- Work with AWS services such as S3, EMR, EC2, and related cloud data components.
- Work on large-scale data processing and transformation using PySpark.
- Write complex SQL queries for data extraction, transformation, analysis, and validation.
- Develop, design, and maintain interactive dashboards and reports using Tableau.
- Build and optimize data pipelines for reporting and analytics use cases.
- Perform data analysis, data profiling, and troubleshooting to ensure accuracy and consistency.
- Collaborate with business users, data engineers, and project stakeholders to understand reporting and data requirements.
- Optimize Tableau dashboards and PySpark jobs for better performance.
- Support data validation,
reconciliation, and issue resolution during development, testing, and deployment.
- Follow best practices for data security, access control, and cloud-based data handling.
- Good working knowledge of PySpark for data processing and transformation.
- Strong SQL skills, including joins, stored procedures, views, analytical functions, and query optimization.
- Experience working with AWS cloud services, especially S3, Airflow and EMR.
- Understanding of data warehousing, data modeling, and ETL/ELT concepts.
- Ability to work with large datasets and perform data validation.
Good to have:
- Robust communication skills and ability to interact with technical and business teams.
- Experience with Hadoop, Hive, Spark SQL, or other big data technologies.
- Knowledge of AWS Glue and Athena will be an added advantage.
- Experience in scheduling or orchestrating data pipelines.
- Understanding of BI performance tuning and dashboard optimization.
- Exposure to banking, financial services, telecom, or enterprise analytics projects will be preferred.
📌 Aws Data Engineer (Mumbai)
🏢 O2 Breathing Brains
📍 Mumbai