Senior Data Engineer- AEP We are combining data programmatic decisioning and real-time delivery to build Customer Data Platforms CDPs complimented by a suite of client-specific managed services Adobe Experience Platform is powerful flexible open system for bulding and managing complete solutions that drive customer experience Experience platform enables organizations to centralize and standardize customer data and content from any system and apply data science and machine learning to deliver consistent interactions at scale across several orchestration layers within any marketing stack Our engineering team is responsible for building the Adobe Experience Platform We help thousands of customers collect manage and synthesize petabytes of data with high fidelity and velocity We help them make sense of that data glean insights and run algorithms so they can deliver delightful experiences in real-time every time If building new secure micro-services in the cloud based on open-source technologies at large-scale is something that might interest you lets share some thoughts we would like to meet Work you ll do We rely on powerfully insightful data to inform our systems and solutions and we re seeking an experienced pipeline-centric Data Engineer to put it to use Our ideal hire will have the mathematical and statistical expertise you d expect combined with a rare curiosity and creativity You ll wear many hats in this role but much of your focus will be building out our Python ETL processes and writing superb SQL Beyond technical prowess you ll need the soft skills it takes to communicate highly complex data trends to organizational leaders in a way that s easy to understand We re looking for someone willing to jump right in to help the company get the most out of our data Your responsibilities will include Analyze customer use case available data to prepare for automated ongoing data ingestion to meet customer requirements Design technical solution with all data ingestion transformation scheduling to review sign-off with customer Identifying AEP enhancements extending frameworks and incorporating new ideas Closely collaborating with other AEP team members sales teams engineers consultants and onshore teams for delivering projects Enterprise level software development leveraging Big Data Cloud technologies Python Building operating highly scalable fault tolerant distributed systems for extraction ingestion to process large data sets Experience with data analysis modeling and mapping to coordinate closely with Data Architect s Build the necessary schemas workflows to ingest customers data into AEP successfully Create necessary identity namespaces privacy settings and merge poilicys required to build the solution Build Audiences segmentations and create necessary pipeline for Destination activation Deploying the final solution to a production environment or end-state environment Post-Deployment provide ongoing maintenance support of solution knowledge transfer to offshore support team Our team You ll join a team of passionate As an engineer in digital marketing and digital media you ll get an unprecedented opportunity to work at the intersection of creative content data science and experience delivery If you re intellectually curious hardworking and solution-oriented you ll fit right into our fast-paced collaborative environment In addition to working daily with our DataScience Team and DevOps Team to deliver production-level pipelines that will run unattended for weeks and months you ll also work closely with our Project Management Team to understand our clients needs and any change requests that drive our development efforts Qualifications Required Graduate Postgraduate in Computer Science Engineering or related fields from a renowned University 5 years experience ETL Data warehousing Solutions Talend Informatica 5 years experience with Real-time processing Framework Apache Spark 2 to 3 year of experience with Adobe Experience Platform Project or POC Database architectures 5 years experience SQL-based technologies e g MySQL Oracle DB 3 years experience NoSQL technologies e g Cassandra and MongoDB Programming Languages Python R Java Knowledge of different Operating System - UNIX Linux Solaris or MS Windows Knowledge of SOA Graph Database CI CD Pipeline monitoring alert would be a plus point Passionate about testing and with extensive experience in Agile teams using SCRUM you consider automated build-and-test to be the norm Proven ability to communicate in both verbal and writing in a high performance collaborative environment Follows data development best practices and enjoy helping others learn to do the same An independent thinker who considers the operating context of what he she is developing Believes that the best data pipelines run unattended for weeks and months on end Familiar with version control you believe that code reviews help to catch bugs improves code base and spread knowledge Ability to travel 5-10 of the time Helpful but not required Knowledge in o Experience with large consumer data sets used in performance marketing is a major advantage o Familiarity with machine learning libraries is a plus o Well-versed in or contributes to data-centric open source projects o Reads Hacker News blogs or stays on top of emerging tools in some other way o Data visualization o Experience with stream-processing systems Apache Spark-Streaming Apache Storm etc o Experience working in open table in-memory table formats for huge analytics dataset Iceberg Parquet Arrow AVRO etc Adobe Qualified - Adobe Experience Platform AEP Certification Technologies of Interest o Languages Libraries - Python Java Scala Spark Kafka Hadoop HDFS Parquet o Cloud - AWS Azure Google How you ll grow At Deloitte Digital our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day From entry-level employees to senior leaders we believe there s always room to learn We offer opportunities to help sharpen skills work with industry-leading talent on a daily basis in addition to hands-on experience in the global fast-changing business world From on-the-job learning experiences to formal development programs at Deloitte University our professionals have a variety of opportunities to continue to grow throughout their career while delivering products and services to Fortune 500 clients Explore Deloitte University The Leadership Center Benefits At Deloitte we know that great people make a great organization We value our people and offer employees a broad range of benefits Learn more about what working at Deloitte can mean for you Deloitte s culture Who says work can t be fun At Deloitte Digital the worlds of business creative and technology intersect to transform the way we work play and communicate We can t quite put our finger on it but that combo creates something kind of magical In studios or on the road we believe in our people and we understand that quality of life directly impacts quality of work We pride ourselves on our adaptable work environment and distinctive culture Learn more about life at Deloitte Digital Corporate citizenship Deloitte is led by a purpose to make an impact that matters This purpose defines who we are and extends to relationships with our clients our people and our communities We believe that business has the power to inspire and transform We focus on education giving skill-based volunteerism and leadership to help drive positive social impact in our communities Learn more about Deloitte s impact on the world Recruiter tips We want job seekers exploring opportunities at Deloitte to feel prepared and confident To help you with your interview we suggest that you do your research know some background about the organization and the business area you re applying to Check out recruiting tips from Deloitte professionals As used in this posting Deloitte means Deloitte Consulting LLP a subsidiary of Deloitte LLP Please see www deloitte com us about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries Certain services may not be available to attest clients under the rules and regulations of public accounting All qualified applicants will receive consideration for employment without regard to race color religion sex sexual orientation gender identity national origin age disability or protected veteran status or any other legally protected basis in accordance with applicable law Our purpose Deloitte s purpose is to make an impact that matters for our people clients and communities At Deloitte purpose is synonymous with how we work every day It defines who we are Our purpose comes through in our work with clients that enables impact and value in their organizations as well as through our own investments commitments and actions across areas that help drive positive outcomes for our communities Our people and culture Our inclusive culture empowers our people to be who they are contribute their unique perspectives and make a difference individually and collectively It enables us to leverage different ideas and perspectives and bring more creativity and innovation to help solve our clients most complex challenges This makes Deloitte one of the most rewarding places to work Professional development At Deloitte professionals have the opportunity to work with some of the best and discover what works best for them Here we prioritize professional growth offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills Our state-of-the-art DU The Leadership Center in India located in Hyderabad represents a tangible symbol of our commitment to the holistic growth and development of our people Explore DU The Leadership Center in India Benefits to help you thrive At Deloitte we know that great people make a great organization Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally physically and financially and live their purpose To support our professionals and their loved ones we offer a broad range of benefits Eligibility requirements may be based on role tenure type of employment and or other criteria Learn more about what working at Deloitte can mean for you Recruiting tips From developing a stand out resume to putting your best foot forward in the interview we want you to feel prepared and confident as you explore opportunities at Deloitte Check out recruiting tips from Deloitte recruiters Requisition code 301349