06 Aug
|
Acme Services Private
|
India
06 Aug
Acme Services Private
India
Job Description:
- Design, develop, and maintain scalable ETL/ELT pipelines using Python, Spark, Databricks, and Snowflake.
- Build and optimize data ingestion frameworks from multiple structured and unstructured data sources.
- Develop data transformation logic and business rules using PySpark and SQL.
- Design and maintain enterprise data warehouses using Snowflake.
- Create effective data models, schemas, views, stored procedures, and tasks in Snowflake.
- Optimize query performance, warehouse utilization, and overall Snowflake cost.
- Develop scalable data processing solutions using Apache Spark on Databricks.
- Collaborate with business analysts, data scientists, and application teams to understand data requirements.
- Monitor data quality, data integrity, and pipeline performance.
- Troubleshoot production issues and perform root cause analysis.
- Implement best practices for data governance, security, and performance optimization.
- Participate in code reviews and mentor junior team members.
- Work in Agile/Scrum development environments.
📌 Data Engineer (Snowflake, spark, Databricks, Python) (India)
🏢 Acme Services Private
📍 India