We are seeking an experienced Full Stack Data Engineer with 5–6 years of industry
experience. The ideal candidate will have a proven track record of working on live projects,
preferably within the manufacturing or energy sectors. He/she will play a key role in developing,
and maintaining scalable data solutions using Databricks and related technologies.

Key Responsibilities:
Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with
various data sources and systems.
Collaborate with cross-functional teams to understand data, and deliver effective BI
solutions.
Implement data ingestion, transformation, and processing workflows using Spark
(PySpark/Scala), SQL, and Databricks notebooks.
Develop and maintain data models, ETL/ELT processes ensuring high performance,
reliability, scalability and data quality.
Build and maintain APIs and data services to support analytics, reporting, and application
integration.
Ensure data quality, integrity, and security across all stages of the data lifecycle.
Monitor, troubleshoot,



and optimize pipeline performance in a cloud-based workplace.
Write clean, modular, and well-documented Python/Scala/SQL/PySpark code.
Integrate data from various sources, including APIs, relational and non-relational databases,
IoT devices, and external data providers.
Ensure adherence to data governance, security, and compliance policies.
Required Skills and Experience:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
5-6 years of hands-on experience in data engineering, with a strong focus on Databricks and
Apache Spark.
Strong programming skills in Python/PySpark and/or Scala, with a deep understanding of
Apache Spark.
Experience with Azure Databricks.
Strong SQL skills for data manipulation, analysis, and performance tuning.
Strong understanding of data structures and algorithms, with the ability to apply them to
optimize code and implement efficient solutions.
Strong understanding

📌 Senior Data Engineer (Hyderabad)
🏢 Koantek
📍 Hyderabad