Data Engineer /Hadoop / SAP in Rosemead, CA at Integrated Resources, Inc

Date Posted: 11/30/2019

Job Snapshot

Job Description


Bachelor's Degree in Information Technology or related specialized field or an equivalent combination of education, training, and experience. Specialized certification may be required. Typically possesses six or more years experience in the field performing analysis and providing recommendations. Ability to provide extensive technical analysis in data planning, engineering and design and make decisions or recommendations for programs and projects development and implementation. Ability to interface with clients to determine requirements. Provides answers to clients by identifying problems; researching answers; guiding client through corrective steps.Improves client references by writing and maintaining documentation.Participates in development of client training programs by identifying learning issues; recommending instructional language.Accommodates client disabilities by recommending devices and techniques.Avoids legal challenges by monitoring compliance with service agreements.Improves system performance by identifying problems; recommending changes.Updates job knowledge by participating in educational opportunities; maintaining personal networks.Accomplishes information systems and organization mission by completing related results as needed.

Day-to-Day Responsibilities/Workload:

The Data Engineer will work with Enterprise Advanced Analytics Data Scientists to perform extensive data engineering activities for advanced analytics use cases. This individual will need to have the ability to conceptualize and develop innovative solutions to address complex data and analytics issues and problems that have impact throughout the business. They will act as an internal consultant in identifying and addressing business issues and providing analysis in support of potential solutions. This includes planning and preparation to facilitate data acquisition, extraction, transformation, management, and manipulation of large and complex data sets for use in advanced analytics.

They will collaborate with analytics architects and data scientists to make recommendations for solution design, development and implementation for analytics solutions. They will drive continuous improvement of data engineering, and business analytics technical capabilities in support of client consultations, defining analytics data requirements, analytics solution evaluations and recommendations, impact assessments, and rapid solution prototyping.
They will conduct research and analysis of business requirements, needs, problems, and available technologies related to data management and engineering in order to create solutions which enhance the business unit's effectiveness and ensures utilization of appropriate technologies. They will be responsible for preparing project plans and tracking progress against goals.

Typical Responsibilities:
Defining data requirements, planning data acquisition and preparation for advanced analytics
Facilitate acquisition, extraction, transformation, management, and manipulation of large and complex data sets.
Develop and promote best practices for analyzing very large data sets
Continuous improvement of data engineering and business analytics technical capabilities
Client consultations, technical solution evaluations, recommendations, impact assessments for analytics solutions
Rapid solution prototyping for analytics use cases
Supports proposal development including final scoping, technical sizing and technical risk assessments
Keeps IT technology and delivery managers aware of key data issues, identifying and resolving potential problems and conflicts
Keep abreast of new and current data science and big data techniques and develop approaches to adopt them.

Required Skills/Attributes:

Bachelor's Degree in a quantitative discipline such as Statistics, Mathematics, Engineering, Computer Science, Data Science, or Information Sciences or related technical discipline.
Must have a minimum of 6 years of IT or technical experience and at least 4 years in a data engineering capacity.
Must have experience in data engineering, data mining, large scale data acquisition, transformation and cleaning both structured and unstructured data.
Must have experience in any of the following technology areas including: data warehouse & data marts design, data modeling, big data, data federation, advance analytics, BI tools and technologies such as SAP BW, SAP Business Objects, SAS, and MS Power BI, R and/or Python, and SQL coding
Strong experience collaborating across teams
Knowledge of product development methodologies including agile Scrum

Desired Skills/Attributes:

Masters Degree in Data Science, Computer Science or similar discipline.
Experience in Energy and Utilities Industry
Experience with SAP Hana and Hadoop ecosystem (eg. HBase, Spark, Impala, Pig, Hive, etc.)
Experience with NoSQL database technologies (e.g., MongoDB, Cassandra, CouchDB)
Experience with cloud computing
Experience with statistical analysis software (e.g. R, SPSS, SAS, RapidMiner)
Experience with Python, SCALA, PHP, and Java