Job DescriptionWe are looking for 20 skilled Data Engineering (DE) professionals with expertise in Databricks, Apache Spark, and Azure cloud to design, develop, and optimize big data solutions. The ideal candidates will have solid experience in data engineering, ETL pipeline development, and performance optimization.
nKey Responsibilities:
nDesign, develop, and optimize ETL pipelines in Databricks.
nBuild data ingestion, transformation, and processing workflows using Apache Spark.
nWork with structured and unstructured data from various sources.
nOptimize Spark jobs for performance, cost efficiency, and scalability.
nImplement CI/CD for Databricks workflows and manage version control.
nWork closely with Data Engineers, DataScientists, and Business Analysts to support analytics and reporting.
nImplement security best practices andmanage access controls in Databricks.
nTroubleshoot performance and scalability issues in big data processing.
nRequired Skills:




nStrong hands-on experience with Databricks and Apache Spark (PySpark/Scala/Java).
nProficiency in SQL for data analysis and transformation.
nExperience in cloud platforms (Azure, AWS,or GCP), especially Azure Data Lake, AWS S3, or GCP BigQuery.
nHands-on experience with ETL tools, DataPipelines, and Data Warehousing.
nStrong knowledge of CI/CD, Git, and DevOpstools for data workflows.
nKnowledge of Delta Lake, Lakehouse architecture, and performance tuning.
nExperience in handling large-scale datasets and distributed computing.
nPreferred Skills:
nExperience with Databricks MLflow and machine learning pipelines.
nKnowledge of Kafka, Airflow, or Snowflake.
nUnderstanding of data governance,compliance, and security policies.
nEducation & Experience:
nBachelor's or Master's degree in ComputerScience, Data Engineering, or a related field.
nExperience in Databricks development

📌 Senior Data Engineer (Hyderabad)
🏢 Texplorers
📍 Hyderabad