Deloitte Data Integration Production Engineer in Washington, District Of Columbia
Data Integration Product Engineer
Are you an experienced, passionate pioneer in technology a product builder, a roll-up-your-sleeves technologist who wants a product development, daily collaborative environment, best-ideas-win feel and chance to break new ground on the hardest big data challenges with your colleagues - without the extensive demands of consulting travel or onsite customer support?
Work you ll do
Making data-driven enterprise-grade decisions are vital to our clients' mission and commercial successes. Practitioners will work within our fast-paced, cross functional team to deliver a data integration and analytics product, MissionGraph. You should be passionate about technology and love learning new technologies and implementing high quality, highly scalable global data and analytics platforms.
As a Data Integration Product Engineer, you will focus on defining, developing, and supporting a flexible data pipeline and data model for a multitude of daily styles and use cases. You will work with a cross-functional team (Product, Design, Engineering, QA, and DevOps) to inform feature development and support customers. Key responsibilities will include:
Work with Apache Spark, Apache Cassandra, Kafka, Apache Solr, and DataStax Enterprise to build the next generation of MissionGraph s data processing pipeline.
Design automated solutions for building, testing, monitoring, and deploying highly scalable ETL pipelines in a continuous integration environment.
Coordinate with backend engineering team to analyze data in order to improve the quality and consistency of our data.
Create data integration pipelines to extract, cleanse, and integrate data from a variety of sources and formats for analysis and use across use cases.
Write balanced scripts for your ingestion code to be generic and able to easily accommodate new data structures/formats in the future, yet execute in a performant manner.
Perform data profiling, discovery, and analysis to identify/determine location, suitability and coverage of data, and identify the various data types, formats, and data quality which exist within a given data source.
Perform hands on data development to build the data extraction, movement and integration, leveraging state of the art tools and practices, including both streaming and batched data ingestion techniques.
Work with the Product team to define the evolution of MissionGraph s data pipeline and data model.
In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment. MissionGraph is a data integration and analytics platform that enables its customers to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making.
Bachelor's degree in Computer Science, Mathematics, or related field.
4 years of related experience.
Deep understanding of relational, NoSQL, and distributed computing and best practices.
Experience in data profiling and data quality of large datasets, especially in a distributed environment like Hadoop.
Hands-on experience building data processing pipelines.
Proficiency with object-oriented and functional languages (e.g. Java, Scala, Python).
Strong scripting ability in Python and command line interfaces, including AWS CLI.
Familiarity with graph theory and entity resolution techniques and models.
Strong debugging, problem solving and investigative skills. Ability to assimilate disparate information (log files, error messages etc.) and pursue leads to find root cause problems.
Experience working within Agile/Scrum methodology. Self-starter who can work independently.
Ability to obtain and maintain the required security clearance
How you ll grow
At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there s always room to learn. We offer opportunities to help sharpen skills in addition to hands-on experience in the global, fast-changing business world. From on-the-job learning experiences to formal development programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career.
At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits.
Deloitte s culture
Our positive and supportive culture encourages our people to do their best work every day. We celebrate individuals by recognizing their uniqueness and offering them the flexibility to make daily choices that can help them to be healthy, centered, confident, and aware. We offer wellbeing programs and are continuously looking for new ways to maintain a culture where our people excel and lead healthy, happy lives. Learn more about Life at Deloitte.
Deloitte is led by a purpose: to make an impact that matters. This purpose defines who we are and extends to relationships with our clients, our people and our communities. We believe that business has the power to inspire and transform. We focus on education, giving, skill-based volunteerism, and leadership to help drive positive social impact in our communities. Learn more about Deloitte s impact on the world. at http://www2.deloitte.com/us/en/pages/about-deloitte/articles/deloitte-corporate-citizenship.html
We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research: know some background about the organization and the business area you re applying to. Check out recruiting tips from Deloitte at http://www2.deloitte.com/us/en/pages/careers/topics/recruiting-tips.html professionals. at http://www2.deloitte.com/us/en/pages/careers/topics/recruiting-tips.html
Category: Management Consulting
As used in this document, Deloitte means Deloitte LLP and its subsidiaries. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.