Data Engineer (Bengaluru)

Data Engineer (Bengaluru)

Dexian APAC supports customers in Oil, Retail and Financial Services sectors. We support high-profile packages with high impact. We are hiring with a good perks package and improved Private Health care package. Location: Bangkok, Thailand
Experience: 7+ years' experience

We are looking to expand our Data Lake team’s capacity in India to better manage the increasing workload, and I would appreciate your collaboration in identifying strong candidates.

Big Data Engineer
Job Description:
Design, develop, and maintain scalable data processing pipelines using Hadoop and Spark.
Implement data integration and ETL processes to ingest and transform large datasets.
Collaborate with data scientists, analysts, business partners and other stakeholders to understand data requirements and deliver solutions.
Optimize and tune Hadoop and Spark jobs for performance and efficiency.
Manage and maintain data storage solutions, ensuring data integrity and security.
Utilize GitHub for version control and collaboration on code development.
Work with CDP (Cloudera Data Platform) to manage and deploy data applications.
Integrate and manage data solutions on Cloud Azure, and Snowflake ensuring seamless data flow and accessibility.
Monitor and troubleshoot data processing workflows, resolving issues promptly.




Stay updated with the latest industry trends and technologies in big data and cloud computing.
Explore and develop skills in newer technologies according to big data technology roadmap.
Integrate and manage data solutions on Cloud Azure and on-premises infrastructure, ensuring seamless data flow and accessibility.

Qualifications:
Strong experience with Apache Spark, Hadoop ecosystem, Hive, Iceberg, HBase, Apache Kafka, Spark Streaming or Flink, and Oozie (Airflow/NiFi good to have).
Proficient in Scala, Java, and/or Python with solid coding and debugging skills.
Applied experience with Solr for indexing and search workloads.
Familiarity with Git/GitHub, GitHub Actions, Azure DevOps; good to have cloud experience (Azure/AWS).
Knowledge of SQL, data modeling (nice to have), and experience working in UNIX or UNIX‑like environments.
Experience with SCRUM or similar Agile frameworks; strong problem‑solving skills; able to produce clear technical documentation.
Self‑starter, effective individual contributor, and good to have Oil & Gas domain knowledge.

Working Time: Shift 2nd 1.00 PM – 10.00 PM
The ideal start date for this position would be 30 days from the offer and will run for 12+ months. Extendable
Resume Email: [email protected]

📌 Data Engineer (Bengaluru)
🏢 Dexian Asia Pacific
📍 Bengaluru