Deloitte Hadoop Big Data Engineer in Mechanicsburg, Pennsylvania
Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center - we are breaking the mold of a typical Delivery Center.
Our US Delivery Centers have been growing since 2014 with significant, continued growth on the horizon. Interested? Read more about our opportunity below...
Work you'll do
A Big Data Architect, Solution Architect at Deloitte will manage and deliver components of client engagements that identify, design, and implement technology and creative business solutions for large companies. Key responsibilities will include:
Manage teams in the identification of business requirements, functional design, process design (including scenario design, flow mapping), prototyping, testing, training, defining support procedures.
Formulate planning, budgeting, forecasting and reporting strategies.
Manage full life cycle implementations.
Develop statements of work and/or client proposals.
Identify business opportunities to increase usability and profitability of information architecture.
Experience with program leadership, governance and change enablement.
Develop and manage vendor relationships.
Lead workshops for client education.
Manage resources and budget on client projects.
Assist and drive the team by providing oversight.
Analytics & Cognitive
In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment.
The Analytics & Cognitive team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. Together with the Strategy practice, our Strategy & Analytics portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.
Analytics & Cognitive will work with our clients to:
Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms
Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions
Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements
3 + years' experience working with Big Data eco-system including tools such as Hadoop, Spark, Map Reduce, Sqoop, HBase, Hive and Impala
Strong technical expertise in most of the following:
Hadoop (Cloudera distribution)
Spark with Scala or Python programming
Experience in building Microservices using Java
Hive Tuning, Bucketing, Partitioning, UDF, UDAF
NOSQL Data Base such as HBase, MongoDB or Cassandra
Experience and knowledge working in Kafka, Spark streaming, Sqoop, Oozie, Airflow, Control-M
Knowledge of working in financial/insurance domain
5+ years of experience of professional work experience
Strong technical skills including understanding of software development principles
Hands-on programming experience
Proficiency in one or more modern programming languages like Python or Scala
Experience on data lakes, datahub implementation
Knowledge on AWS or Azure platforms
Knowledgeable in techniques for designing Hadoop-based file layout optimized to meet business needs
Able to translate business requirements into logical and physical file structure design
Ability to build and test solution in agile delivery manner
Ability to articulate reasons behind the design choices being made
Bachelor of Science in Computer Science, Engineering, or MIS, or equivalent experience
Any bigdata certification is a plus
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.