Deloitte Data Engineer- Python in San Francisco, California
As a SeniorConsultant, you will focus on managing the information supply chain fromacquisition to ingestion, storage and the provisioning of data to points ofimpact by modernizing and enabling new capabilities. Information value isenhanced through enterprise-scale applications that enable visualization,consumption and monetization of both structured and unstructured data. Big datais becoming one of the most important technology trends that has thepotential for dramatically changing the way organizations useinformation to enhance the customer experience and transform theirbusiness models.
Work you'll do
Senior Consultants workwithin an engagement team. Key responsibilities will include:
Function as integratorsbetween business needs and technology solutions, helping to create technologysolutions to meet clients business needs.
Identifying businessrequirements, requirements management, functional design, prototyping, processdesign (including scenario design, flow mapping), testing, training, definingsupport procedures and supporting implementations.
In this age ofdisruption, organizations need to navigate the future with confidence,embracing decision making with clear, data-driven choices that deliverenterprise value in a dynamic business environment.
The Analytics &Cognitive team leverages the power of data, analytics, robotics, science andcognitive technologies to uncover hidden relationships from vast troves ofdata, generate insights, and inform decision-making. Together with the Strategypractice, our Strategy & Analytics portfolio helps clients transform theirbusiness by architecting organizational intelligence programs anddifferentiated strategies to win in their chosen markets.
Analytics &Cognitive will work with our clients to:
Implement large-scaledata ecosystems including data management, governance and the integration ofstructured and unstructured data to generate insights leveraging cloud-basedplatforms
Leverage automation, cognitiveand science-based techniques to manage data, predict scenarios and prescribeactions
Drive operationalefficiency by maintaining their data ecosystems, sourcing analytics expertiseand providing As-a-Service offerings for continuous insights and improvements
5 years of experience in core JAVA andSQL
3 years of experience in Python&Unix Shell Scripting
3 years of experience in buildingscalable and high performance data pipelines using Apache Hadoop, Map Reduce,Pig & Hive
Experience with bigdata cross platformcompatible file formats like Apache Avro & Apache Parquet
Experience in Apache Spark is a plus
1 years of experience with data lakeimplementations, core modernizations and data ingestion
1 or more years of handson experience designing and implementing data ingestion techniques for realtime and batch processes for video, voice, weblog, sensor, machine and socialmedia data into Hadoop ecosystems and HDFS clusters.
2 years of experienceleading workstreams or small teams
Willingness for weeklyclient-based travel, up to 80-100% (Monday Thursday/Friday)
Bachelor s Degree orequivalent professional experience
AWS Certification, Hadoop Certification or Spark Certification
Experience with Cloud using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
Experience with data integration products like Informatica Power Center Big Data Edition (BDE), IBM BigInsights, Talend etc.
Experience designing and implementing reporting and visualization for unstructured and structured data sets
Experience in designing and implementing scalable, distributed systems leveraging cloud computing technologies like AWS EC2, AWS Elastic Map Reduce and Microsoft Azure
Experience designing and developing data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching
Knowledge of data, master data and metadata related standards, processes and technology
Experience working with multi-Terabyte data sets
Experience with Data Integration on traditional and Hadoop environments
Ability to work independently, manage small engagements or parts of large engagements.
Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint).
Strong problem solving and troubleshooting skills with the ability to exercise mature judgment.
Eagerness to mentor junior staff.
An advanced degree in the area of specialization is preferred.
How you ll grow
At Deloitte, ourprofessional development plan focuses on helping people at every level of theircareer to identify and use their strengths to do their best work every day.From entry-level employees to senior leaders, we believe there s always room tolearn. We offer opportunities to help sharpen skills in addition to hands-onexperience in the global, fast-changing business world. From on-the-joblearning experiences to formal development programs at Deloitte University, ourprofessionals have a variety of opportunities to continue to grow throughouttheir career. ExploreDeloitte University, The Leadership Center. at https://zoomforth.com/s/deloitte/du#home
At Deloitte, we knowthat great people make a great organization. We value our people and offeremployees a broad range of benefits. Learn more about what working at Deloitte can mean for you. at http://www2.deloitte.com/us/en/pages/careers/articles/life-at-deloitte-benefits-and-rewards.html
Deloitte s culture
Our positive andsupportive culture encourages our people to do their best work every day. Wecelebrate individuals by recognizing their uniqueness and offering them theflexibility to make daily choices that can help them to be healthy,centered, confident, and aware. We offer well-being programs and arecontinuously looking for new ways to maintain a culture where our people exceland lead healthy, happy lives. Learn more about Life at Deloitte.
Deloitte is led by apurpose: to make an impact that matters. This purpose defines who we are andextends to relationships with our clients, our people and ourcommunities. We believe that business has the power to inspire andtransform. We focus on education, giving, skill-based volunteerism, andleadership to help drive positive social impact in our communities. Learn more about Deloitte s impact on the world. at http://www2.deloitte.com/us/en/pages/about-deloitte/articles/deloitte-corporate-citizenship.html
We want job seekersexploring opportunities at Deloitte to feel prepared and confident. To help youwith your interview, we suggest that you do your research: know some backgroundabout the organization and the business area you re applying to. Check out recruiting tips from Deloitte professionals. at http://www2.deloitte.com/us/en/pages/careers/topics/recruiting-tips.html
As used in this document, Deloitte means Deloitte LLP and its subsidiaries. Please see www.deloitte.com/us/about for a detailed description of the legal structure of Deloitte LLP and its subsidiaries. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.