Architect- Data Engineering (Architect - 2 ) Location: BangaloreMode: HybridNotice period: Max 30 days (Immediate / short notice preferred)Experience: Architect: 14+ YearsJob Description:Role SummaryWe are looking for an experienced Architect - Data Engineering with 14+ years of experience and strong expertise in AWS, Databricks, PySpark, and Python. The ideal candidate will lead the design, development, and optimization of scalable data platforms and pipelines, provide technical leadership to a team of data engineers, and collaborate with business and technology stakeholders to deliver secure, reliable, and high-performing data solutions.Key SkillsAWS Cloud Services (S3, Glue, EMR, Redshift, Lambda, IAM, EC2)DatabricksPySparkApache AirflowETL/ELT Pipeline DevelopmentData Modeling & Data ArchitectureSQL & Performance OptimizationPythonMust-Have SkillsExperience with Databricks for data engineering and analyticsStrong expertise in AWS Cloud Services (S3, Glue, EMR, Lambda, Redshift, IAM,
EC2)Expert-level proficiency in PySpark for large-scale data processingHands-on experience in designing and developing ETL/ELT pipelinesAdvanced SQL and Data Modeling skillsStrong programming experience in PythonGood-to-Have SkillsBig Data technologies such as Spark Streaming, Hadoop, and KafkaCI/CD and DevOps practicesInfrastructure as Code (Terraform, CloudFormation)Docker and KubernetesAgile methodologiesExposure to Snowflake, Azure Data Factory, or GCP Data ServicesRoles & ResponsibilitiesLead the design, development, and implementation of scalable data engineering solutionsDefine architecture standards and best practices for data platformsReview technical designs and ensure adherence to engineering standardsDrive technical innovation and continuous improvement initiativesMentor and guide a team of Data EngineersFoster a cooperative and high-performance engineering cultureBuild and maintain data pipelines using AWS, Databricks, PySpark, and AirflowDevelop high-performance ETL/ELT processes for structured and unstructured dataDesign and optimize data models to support reporting, analytics, and machine learning use casesEnsure high availability, reliability, and scalability of data platformsRegardsVibha
[email protected]
📌 Architect - Data Engineering (Bengaluru)
🏢 Quantum Integrators
📍 Bengaluru