Data Engineer/ETL Developer

Hybrid, Tues-Thur in office, must be local

Need Valid LinkedIn

Candidates need to take a video screen with prime vendor prior to end client submittal

Possible CTH role

Business Objectives & Key Project Details

Still a few years before they move to the cloud.

Lots of cleanup is still needed with the Data Warehouse + new business cases/requests

Looking at opportunities with Data Fabric and “real-time” stuff

DataStage

Source system – 8-9 of them (Workday, Salesforce

Currently Product Owner is managing the 2-week sprints

Job Description

Required Skills Oracle – Dimensional to organized data sets

Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and development tests; Monitor results and take corrective actions; Translate data access, transformation, and movement requirements into functional requirements and mapping designs. Use SQL to design database schemas, optimize data retrieval, and implement ETL processes. Investigate, analyze, and resolve complex technical problems related to system functions, environment, and procedures; Manage service levels, standards, and configurations; Participate in Agile teams to meet goals; Development and support Kafka integrations, including topics, producers, consumers, and streaming applications; Design, develop and maintain Enterprise microservices – security, logging, common APIs and enforcing coding standards.

Job Requirements

• Bachelor’s degree in computer science, Computer Engineering, Electrical/Electronic Engineering, or related technical field and 7 years of software development experience.
• Must have extensive hands-on experience in designing, developing, and maintaining software solutions on ETL process utilizing IBM Infosphere DataStage/Quality Stage.
• Design, build and maintain batch or real-time data pipelines.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
• Monitor data systems performance and implement optimization strategies.
• Must have experience with analyzing, tuning, and optimizing queries in the RDBMS.
• Strong computer skills, including proficiency in at least one programming language (C/C++, Java)
• Experience with large datasets, including structured and unstructured data.
• Knowledge of Kafka and messaging is a plus.
• Must be able to produce thorough technical design documents, test plans and documented results.
• Experience with Agile methodologies and fast-paced environment preferred.
• Experience developing API Integrations with cloud and other applications.
• Experience building applications using Java and Java based frameworks like Spring Boot is strongly preferred.
• Strong Skills on SQL, PL/SQL Programming, Query Optimization.
• Knowledge of Data Management Strategies (ETL Frameworks, Data Modeling concepts)
• Strong understanding of relational databases, oracle functions, procedures, triggers and packages.
• Willingness to learn new technologies.
• Excellent verbal and written communication skill to clearly and simply communicate complex information.
  
  

Experience

• 5+ years’ experience working in a Data Warehouse environment (or equivalent).
• 6 years of experience with the design, development, automation, and support of applications to extract, transform, and load data;
• 6 years of experience with databases, including Oracle, DB2, Teradata, SQL Server, and Access;
• 6 years of experience with IBM InfoSphere DataStage;
• 6 years of experience with Data warehouse;
• 6 years of experience with Unix Shell Scripting;
• 6 years of experience working within an Agile Scrum environment.
• 2+ years of experience with Spring boot is preferred.
• Knowledge of Kafka and streaming solutions is a plus.