18 Sep
|
DynaTech Systems
|
India
18 Sep
DynaTech Systems
India
Data Engineer
Data Engineering
Full Time
India
Job Summary
We are looking for a Data Engineer with 3+ years of experience in designing, developing, and maintaining scalable data pipelines. The ideal candidate should have solid hands-on experience in Python, PySpark, and Databricks for building up-to-date data engineering solutions.
Key Responsibilities
Develop, maintain, and optimize ETL/ELT data pipelines.
Build scalable data processing solutions using Python and PySpark.
Design and implement data workflows in Databricks.
Perform data ingestion, transformation, and validation from multiple data sources.
Optimize Spark jobs for performance and cost efficiency.
Work with structured and unstructured datasets.
Collaborate with business analysts, data architects, and stakeholders to understand data requirements.
Ensure data quality, governance, and security standards are maintained.
Troubleshoot and resolve data pipeline issues.
Required Skills Qualifications
3+ years of experience in Data Engineering.
Minimum 2 years of hands-on experience with Python.
Solid experience with PySpark.
Mandatory experience with Databricks.
Experience with SQL and database concepts.
Understanding of ETL/ELT processes and data warehousing concepts.
Experience working with cloud-based data platforms.
Knowledge of Git and CI/CD practices.
Preferred Skills
Experience with Azure Data Lake, AWS S3, or similar storage platforms.
Exposure to Delta Lake.
Knowledge of data modeling and performance tuning.
Familiarity with Azure services.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer Ahmedabad (India)
🏢 DynaTech Systems
📍 India