Deloitte Senior Data Engineer, Data Core in New York, New York
Senior Data Engineer, Data Core
Locations: Greensboro, NC | Raleigh, NC | Charlotte, NC | New York, NY
Are you a talented software engineer with outstanding Python skills? Passionate about creating innovative Data Pipelines from scratch to solve real-world problems? Deloitte Digital is seeking creative minds and persistent problem solvers to build and support cutting-edge marketing AI Platform that help our clients deliver meaningful, personalized journeys to delight their customers at every touch point.
At Deloitte Digital, we build state-of-the-art marketing Platform that give our clients a single view of their customers brand interactions across all channels (in-store, online, call centers), and enable our clients to deliver tailored marketing offers that maximize customer happiness and value.
We re growing fast and need brilliant Senior Data Engineers like you to fuel our continuing innovation and growth. Along the way, you ll find exceptional growth opportunities limited only by your hunger for learning and applying new technologies in our exciting, start-up-like environment.
Work you ll do
As a Senior Data Engineer, you ll design, implements, maintain a full suite of real-time and batch jobs that fuels our cutting edge AI to provide real-time marketing intelligence to our existing clients.
You ll develop, test and deliver production grade code to help our clients solve their most marketing challenges using cutting edge big data tools. You ll also ensure data integrity, resolve production issues, and assist in the support and maintenance of our overall Platform.
As you grow your capabilities and learn how to build a platform that can ingest, load and process billions of data points, you ll enjoy new challenges and opportunities to showcase your development skills by joining project teams to build innovative new-client platform and execute high-value strategic development projects with high visibility.
Your responsibilities will include:
Design, construct, install, test and maintain highly scalable data pipelines with state-of-the-art monitoring and logging practices.
Bring together large, complex and sparce data sets to meet functional and non-functional business requirements.
Design and implements data tools for analytics and data scientist team members to help them in building, optimizing and tuning our product.
Integrate new data management technologies and software engineering tools into existing structures.
Help in building high-performance algorithms, prototypes, predictive models and proof of concepts.
Use a variety of languages, tools and frameworks to marry data and systems together.
Recommend ways to improve data reliability, efficiency and quality.
Collaborate with Data Scientists, DevOps and Project Managers on meeting project goals.
Tackle challenges and to solve complex problems on a daily basis.
You ll join a team of passionate, talented Data Engineers who collaborate to design, build and maintain cutting-edge AI solutions that arm our clients with real-time customer insights delivering tremendous value. If you re intellectually curious, hardworking and solution-oriented, you ll fit right into our fast-paced, collaborative environment.
In addition to working daily with our DataScience Team and DevOps Team to deliver production level grade pipelines that will run unattended for weeks and months. you ll also work closely with our Project Management Team to understand our clients needs and any change requests that drive our development efforts.
Proven track record of 8 years of experience in software development, a substantial part of which was gained in a high-throughput, decision-automation related environment.
4 years of experience in working with big data using technologies like Spark, Kafka, Flink, Hadoop, and NoSQL datastores.
3 years of experience on distributed, high throughput and low latency architecture.
1 years of experience deploying or managing data pipelines for supporting data-science-driven decisioning at scale.
A successful track-record of manipulating, processing and extracting value from large disconnected datasets.
Producing high quality code in Python.
Passionate about testing, and with extensive experience in Agile teams using SCRUM you consider automated build and test to be the norm.
Proven ability to communicate in both verbal and writing in a high performance, collaborative environment.
Follows data development best practices, and enjoy helping others learn to do the same.
An independent thinker who considers the operating context of what he/she is developing.
Believes that the best data pipelines run unattended for weeks and months on end.
Familiar with version control, you believe that code reviews help to catch bugs, improves code base and spread knowledge.
Travel up to 10% (While 10% of travel is a requirement of the role, due to COVID-19, non-essential travel has been suspended until further notice.)
Limited immigration sponsorship may be available
Helpful, but not required:
Experience with Test Driven Development, automated testing tools like Junit, Selenium or Cucumber
Experience designing and developing enterprise scale applications utilizing cloud native functionality on AWS, Azure or GCP
Experience with large consumer data sets used in performance marketing is a major advantage.
Familiarity with machine learning libraries is a plus.
Well-versed in (or contributes to) data-centric open source projects.
Reads Hacker News, blogs, or stays on top of emerging tools in some other way
Industry-specific marketing data
Technologies of Interest:
Languages/Libraries Python, Java, Scala, Spark, Kafka, Hadoop, HDFS, Parquet.
Cloud AWS, Azure, Google
How you ll grow
At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there s always room to learn. We offer opportunities to help sharpen skills in addition to hands-on experience in the global, fast-changing business world. From on-the-job learning experiences to formal development programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Center. at https://zoomforth.com/s/deloitte/du#home
At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you. at http://www2.deloitte.com/us/en/pages/careers/articles/life-at-deloitte-benefits-and-rewards.html
Deloitte s culture
Our positive and supportive culture encourages our people to do their best work every day. We celebrate individuals by recognizing their uniqueness and offering them the flexibility to make daily choices that can help them to be healthy, centered, confident, and aware. We offer well-being programs and are continuously looking for new ways to maintain a culture where our people excel and lead healthy, happy lives. Learn more about Life at Deloitte.
Deloitte is led by a purpose: to make an impact that matters. This purpose defines who we are and extends to relationships with our clients, our people and our communities. We believe that business has the power to inspire and transform. We focus on education, giving, skill-based volunteerism, and leadership to help drive positive social impact in our communities. Learn more about Deloitte s impact on the world. at http://www2.deloitte.com/us/en/pages/about-deloitte/articles/deloitte-corporate-citizenship.html
We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research: know some background about the organization and the business area you re applying to. Check out recruiting tips from Deloitte professionals. at http://www2.deloitte.com/us/en/pages/careers/topics/recruiting-tips.html
As used in this posting, Deloitte means Deloitte Consulting LLP, a subsidiary of Deloitte LLP. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. Certain services may not be available to attest clients under the rules and regulations of public accounting.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.
Category: Management Consulting
As used in this document, Deloitte means Deloitte LLP and its subsidiaries. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.