As a Big Data Engineer (Azure), you will build and
learn about a variety of analytics solutions & platforms, data lakes,
modern data platforms, data fabric solutions, etc. using different Open Source,
Big Data, and Cloud technologies on Microsoft Azure.

On a typical day, you might

â Design and build scalable & metadata-driven data
ingestion pipelines (For Batch and Streaming Datasets)

â Conceptualize and execute high-performance data
processing for structured and unstructured data, and data harmonization

â Schedule, orchestrate, and validate pipelines

â Design exception handling and log monitoring for
debugging

â Ideate with your peers to make tech stack and
tools-related decisions

â Interact and collaborate with multiple teams
(Consulting/Data Science & App Dev) and various stakeholders to meet
deadlines, to bring Analytical Solutions to life. What do we expect?

â 4 to 9 years of total IT experience with 4+ years in
big data engineering and Microsoft Azure

â Experience in implementing Data Lake with
technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS,



Azure
SQL Database

â A comprehensive foundation with working knowledge of
Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB,
and Purview

â A passion for writing high-quality code and the code
should be modular, scalable, and free of bugs (debugging
skills in SQL, Python, or Scala/Java).

â Enthuse to collaborate with various stakeholders
across the organization and take complete ownership of deliverables.

â Experience in using big data technologies like
Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic Search

â Adept understanding of different file formats like
Delta Lake, Avro, Parquet, JSON, and CSV

â Positive knowledge of building and designing REST APIs
with real-time experience working on Data Lake or Lakehouse projects

Experience in supporting BI and Data Science teams in
consuming the data in a secure and governed manner

â Certifications like Data Engineer

📌 Azure Data Engineer (Hyderabad)
🏢 2COMs
📍 Hyderabad