Software Engineer Java Azure Data Engineering - Expert Polyglot and AI Driven Developer Overview A highly experienced engineer with 5 years of deep programming expertise who thrives on solving complex problems independently and in teams Primarily skilled in Java 8 complemented by strong proficiency in Azure data engineering ADF Databricks ADLS PySpark and Vue js for front-end development Comfortable navigating multiple programming paradigms and equipped to work on full stack cloud native and data intensive development at pace and quality Key Responsibilities Backend APIs Java Design and develop scalable microservices and APIs using Java Spring Boot with maintainable and secure code Front end Create responsive modular front-end applications with Vue js or similar following sound UI UX and component design Cloud DevOps Deploy and manage cloud infrastructure on Azure leveraging DevOps pipelines containers Docker Kubernetes and infrastructure as code Data Engineering - Batch Orchestration Build and operate Azure Data Factory ADF pipelines triggers activities mapping data flows for ingestion from APIs databases and files Develop scalable data transformations in Azure Databricks using PySpark and Delta Live Tables DLT for reliable declarative pipelines API Data Consumption Design and implement robust ingestion frameworks to consume data from REST APIs handle pagination authentication and error recovery for large-scale data loads Data Lake Storage Implement Medallion Architecture Bronze Silver Gold on ADLS Gen2 with proper folder hierarchy ACLs governance and cost optimization Integrate Azure Blob Storage and Azure SQL Database for curated and serving layers Real Time Streaming Design and maintain streaming pipelines using Azure Kafka integration e g Azure Event Hubs with Kafka protocol and Spark Structured Streaming for low-latency data products Performance Engineering Optimize PySpark jobs for partitioning caching shuffle reduction and broadcast joins Tune ADF pipelines for efficient data movement and concurrency Apply SQL query optimization techniques indexes joins window functions for faster retrieval Design and optimize database views for downstream analytics and BI consumption Data Modeling Performance Design schemas star snowflake optimize queries SQL window functions CTEs and ensure efficient retrieval for downstream analytics BI Analytics Enablement Prepare analytics-ready datasets and semantic models for visualization tools like Power BI and Apache Superset ensure proper data contracts for downstream consumers Partner with web teams to implement Google Tag Manager GTM tagging and telemetry that power Google Analytics and downstream analytics Collaboration Leadership Collaborate globally with product owners architects data scientists and developers mentor peers on clean code data best practices and continuous learning Own commitments and deliver high-quality software within deadlines Essential Skills and Tools Java 8 In-depth knowledge of core Java concurrency JVM internals and functional programming paradigms Frameworks Expertise in Spring Boot Spring Security Hibernate and reactive frameworks WebFlux Frontend Strong skills in Vue js modern JavaScript TypeScript and CSS preprocessors Data Engineering Programming Scripting Java or Python data ingestion transformation SQL advanced joins window functions CTEs PySpark large-scale transformations Azure Data Services Azure Data Factory ADF Pipelines triggers activities Mapping Data Flows CI CD with Azure DevOps Azure Databricks Notebooks PySpark Delta Lake Delta Live Tables job clusters Unity Catalog governance Storage ADLS Gen2 hierarchy ACLs Azure Blob Azure SQL Database Real Time Processing Azure Kafka integration e g Event Hubs Kafka endpoint Spark Structured Streaming Data Warehousing Modeling Medallion Architecture Bronze Silver Gold dimensional modeling star snowflake surrogate keys CDC patterns Visualization Tools Power BI Apache Superset and integration with downstream analytics platforms Web Analytics Google Tag Manager GTM for event tagging collaboration on Google Analytics instrumentation and taxonomy Performance Engineering PySpark optimization partitioning caching shuffle reduction ADF pipeline tuning parallelism concurrency SQL query optimization indexes joins views Efficient view design for BI and reporting Platform Engineering Excellence Cloud Platforms Proficient with Microsoft Azure services including App Services AKS Azure DevOps Build Dependency Maven Gradle with effective repository management Version Control Solid knowledge of Git branching strategies pull requests merge workflows CI CD Jenkins GitHub Actions Azure Pipelines Containers Orchestration Docker Kubernetes AKS Helm Database Technologies PostgreSQL MongoDB Azure SQL Database schema design indexing partitioning and query optimization Collaboration Agile Experience in distributed teams using Scrum Agile excellent verbal and written communication Attributes Self disciplined and reliable delivering commitments on schedule with excellence Fast learner with a passion for new technologies and data performance optimization Strong problem solver who values code quality data reliability and maintainability Team player willing to take on challenges and mentor others across application and data disciplines Maersk is committed to a diverse and inclusive workplace and we embrace different styles of thinking Maersk is an equal opportunities employer and welcomes applicants without regard to race colour gender sex age religion creed national origin ancestry citizenship marital status sexual orientation physical or mental disability medical condition pregnancy or parental leave veteran status gender identity genetic information or any other characteristic protected by applicable law We will consider qualified applicants with criminal histories in a manner consistent with all legal requirements We are happy to support your need for any adjustments during the application and hiring process If you need special assistance or an accommodation to use our website apply for a position or to perform a job please contact us by emailing accommodationrequests maersk com