Data Engineer
Horizontal Talent

Job Info

***Onsite position at client in Fort Worth, TX***

Role Description
We are looking for a Data Engineer to perform various tasks during the Data Warehouse implementation like analyses, database and architecture design, gathering business requirements, creating testing and implementation scenarios, developing and implementing planned solutions etc.

Key Areas of Responsibility:
• Performing data warehouse tasks for large projects (from gathering requirements to testing, implementation, and support)
• Providing solutions for improved performance with exceptional relationship management skills with the ability to communicate to various levels of business customer and management.
• Responsible for making recommendations on custom applications, designing, and developing efficient ETL methodologies as well as engaging in change and impact analysis
• Deliver solutions based on functional requirements and develop program specifications
• Design and develop complex queries, stored procedures, tables, views, and functions as well as create shell scripts as per requirements.
• Profiling, validating, conditioning, transforming and cleansing of data by applying business rules and transformations for data extraction and loading (ETL) from various sources to a target data warehouse.
• Perform unit testing system testing in support of performance tuning and optimization for the custom development of key code modules
• Develop DevOps specifications and processes based on the client's requirements

Basic requirements:
• Over 8 years experience working on DWH projects
• Experience with collecting business requirements and transforming them to the technical solution
• Strong Python / Pyspark and Azure Databricks a must
• Deep knowledge of the Teradata database
• ETL development, implementation, documentation and testing experience
• Experience with DataStage 11.x, and best practices
• Data Factory and Azure DevOps recommended
• Experience with the creation/modification of a Data Model and Mappings or Technical ETL specifications (Source to Target Mapping)
• Onsite position at client in Fort Worth, TX

Preferred requirements:
• Knowledge of scripting and programming
• Knowledge of additional third-party ETL tools, and best practices
• Experience with Github, UCD, unix, JIRA, Tivoli
• Knowledge of Teradata products and tools and utilities
• Experience with End to End solution development