13 Nov
|
Mindpool Technologies
|
Bengaluru
13 Nov
Mindpool Technologies
Bengaluru
Required Skills
- At least 3 years of hands-on experience with PySpark, Python, Spark, and Scala, including data validation, data quality, and data delivery practices.
- At least 3 years of Snowflake and/or Databricks Cloud Data Warehouse implementation experience.
- Experience working with structured, semi-structured, and unstructured data formats including XML, JSON, Avro, and Parquet.
- Strong experience developing ETL/ELT solutions across multiple enterprise data sources.
- Solid understanding of modern data engineering and cloud data platform concepts.
- Experience working with modern schedulers and orchestration tools such as Airflow, Matillion, or similar platforms.
- Experience working with distributed data processing technologies including Hadoop, Spark, Kafka, and streaming frameworks.
- Experience supporting business intelligence, reporting, and analytics solutions using Power BI, Tableau, or similar visualization platforms.
- Good working knowledge of AWS technologies including EC2, S3, Lambda, SQS, and SNS.
- Strong programming experience using SQL and PL/SQL, including packages, stored procedures, views, materialized views, triggers, and indexing strategies.
- Strong understanding of Data Warehousing concepts including Fact and Dimension modeling, Star Schemas, and data loading methodologies.
- Hands-on experience implementing Big Data processing solutions using Python and Spark.
- Experience with CI/CD and DevOps practices using Jenkins, Terraform, Docker, AWS, Git, and Kubernetes.
- Experience applying AI-assisted development tools and AI-Driven Development Lifecycle (AI-DLC) practices to improve development productivity and solution delivery.
- Familiarity with Generative AI tools such as GitHub Copilot, Microsoft Copilot, ChatGPT, or equivalent AI-assisted engineering platforms.
- Ability to leverage AI for code generation, test automation, documentation creation, troubleshooting, and engineering process optimization.
- Strong analytical, problem-solving, and troubleshooting skills.
- Excellent communication, collaboration, and stakeholder management skills.
- Experience in the Pharma, Healthcare, Diagnostics, or Life Sciences industry is a plus.Role & responsibilities
Preferred candidate profile
Perks and benefits
📌 Data Engineer (Bengaluru)
🏢 Mindpool Technologies
📍 Bengaluru