13 Nov
|
Mindpool Technologies
|
Bengaluru
13 Nov
Mindpool Technologies
Bengaluru
Required Skills
At least 3 years of hands-on experience with PySpark, Python, Spark, and Scala, including data validation, data quality, and data delivery practices.
At least 3 years of Snowflake and/or Databricks Cloud Data Warehouse implementation experience.
Experience working with structured, semi-structured, and unstructured data formats including XML, JSON, Avro, and Parquet.
Solid experience developing ETL/ELT solutions across multiple enterprise data sources.
Strong understanding of modern data engineering and cloud data platform concepts.
Experience working with modern schedulers and orchestration tools such as Airflow, Matillion, or similar platforms.
Experience working with distributed data processing technologies including Hadoop, Spark, Kafka, and streaming frameworks.
Experience supporting business intelligence, reporting, and analytics solutions using Power BI, Tableau, or similar visualization platforms.
Good working knowledge of AWS technologies including EC2, S3, Lambda, SQS, and SNS.
Robust programming experience using SQL and PL/SQL, including packages, stored procedures, views, materialized views, triggers, and indexing strategies.
Solid understanding of Data Warehousing concepts including Fact and Dimension modeling, Star Schemas, and data loading methodologies.
Hands-on experience implementing Big Data processing solutions using Python and Spark.
Experience with CI/CD and DevOps practices using Jenkins, Terraform, Docker, AWS, Git, and Kubernetes.
Experience applying AI-assisted development tools and AI-Driven Development Lifecycle (AI-DLC) practices to improve development productivity and solution delivery.
Familiarity with Generative AI tools such as GitHub Copilot, Microsoft Copilot, ChatGPT, or equivalent AI-assisted engineering platforms.
Ability to leverage AI for code generation, test automation, documentation creation, troubleshooting, and engineering process optimization.
Strong analytical, problem-solving, and troubleshooting skills.
Excellent communication, collaboration, and stakeholder management skills.
Experience in the Pharma, Healthcare, Diagnostics, or Life Sciences industry is a plus.Role & responsibilities
Preferred candidate profile
Perks and benefits
📌 Data Engineer Bengaluru
🏢 Mindpool Technologies
📍 Bengaluru