13 Oct
|
Spark Tech Wave Innovation
|
India
13 Oct
Spark Tech Wave Innovation
India
Data Engineer Python | SQL | ETL | Cloud
Company: Spark Techwave InnovationZ Pvt Ltd
Job Type: Full-Time
Experience: 1–15 Years
Location: Chennai / Remote / Hybrid
Department: Data & Engineering
Job Summary
Spark Techwave InnovationZ Pvt Ltd is looking for a Data Engineer to design, build, and maintain scalable data pipelines and data-processing solutions.
The ideal candidate should have strong knowledge of Python, SQL, ETL/ELT concepts, databases, and data pipeline development. Experience with cloud platforms and modern data engineering tools will be an advantage.
Key Responsibilities
- Develop and maintain reliable data pipelines and ETL/ELT workflows.
- Extract, transform, and load data from multiple sources.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Develop data-processing solutions using Python.
- Work with relational and/or NoSQL databases.
- Perform data validation, quality checks, and troubleshooting.
- Optimize data pipelines for performance, scalability, and reliability.
- Collaborate with Data Analysts, Data Scientists, Software Engineers, and other stakeholders.
- Monitor pipeline execution and resolve data-related issues.
- Document data pipelines, processes, and technical solutions.
- Follow best practices for data security, data quality, and pipeline reliability.
Required Skills
- Strong knowledge of Python.
- Strong knowledge of SQL.
- Understanding of ETL/ELT processes.
- Experience with relational databases such as MySQL, PostgreSQL, or SQL Server.
- Understanding of data warehousing concepts.
- Good understanding of data structures and data processing.
- Knowledge of APIs and data integration.
- Strong problem-solving and analytical skills.
Good to Have
- Experience with AWS, Azure, or Google Cloud.
- Knowledge of Apache Spark / PySpark.
- Experience with Airflow or other workflow orchestration tools.
- Knowledge of data warehouses such as Snowflake, BigQuery, Redshift, or Azure Synapse.
- Experience with Docker and Git.
- Understanding of CI/CD.
- Knowledge of Kafka or other streaming technologies.
Education
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
Who Can Apply
Candidates with experience in:
- Data Engineering
- ETL Development
- Python Development
- SQL Development
- Data Analytics with strong programming skills
- Backend/Data Pipeline Development
What We Offer
- Opportunity to work on real-world data engineering projects.
- Exposure to modern data and cloud technologies.
- Collaborative learning setting.
- Opportunities to develop expertise in data engineering and analytics.
Interested candidates can apply with their updated resume at
[email protected]
📌 Data Engineer (India)
🏢 Spark Tech Wave Innovation
📍 India