dreamwork_

RQ11301 - Sr. Software Developer - ETL

9+ month contract (182 business days) - possible extension

ONSITE 5 days(182 business days) - possible extension

Security Level: CRJMC

Must-haves

  • · Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  • Extensive experience in design, development, and implementation with Azure Data Factory, Databricks

o Self-Hosted Integration Runtime

o Data movement, ETL pipelines

o Performance tuning on large data volumes

o Complex data transformations

o ADF Debugger to validate data transformation.

o Azure Roles

  • Experience with Informatica, including:

o Workflow Manager

o Repository Manager

o Designer

o Workflow Monitor

  • Experience with developing solutions using Logic App and Function App.
  • Experience in rapid application development (RAD) methodologies.
  • Experience in maintaining and improving existing ETL processes.
  • Experience in investigating data to identify potential issues within ETL pipelines.
  • Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
  • Experience with CI/CD (DevOps) pipelines and concepts, including:

o Azure Resource Management
o GitHub Repo
o Source code version control
o Branching, pull requests, build, release, multiple parallel development repositories merge.

  • Experience with Azure DevOps, including:

o Azure Boards
o Azure Test Plans
o Azure Pipelines
o Azure Repos
o Azure Artefacts

  • Extensive experience in designing and developing SQL Server Stored Procedures, Oracle PL/SQL programs.

Azure SQL DB and Synapse platforms

Responsibilities

  • Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities. Required to translate technical systems specifications into working, tested applications.
  • This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
  • Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.

General Skills

  • Experience in programming and analysis; specialized software package support at the specified experience level
  • Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
  • Experience in structured methodologies for the development, design, implementation and maintenance of applications Experience in design, code, test, debug and document applications
  • Experience in the use of object and/or third generation language development tools
  • Experience in one or more programming languages
  • Experience in application design, latest design patters, deployment and troubleshooting
  • Experience with relational and hierarchical database technologies
  • Experience in the use of information retrieval packages using query languages
  • Experience with one or more communications protocols
  • Experience in structured methodologies for the design, development, implementation and maintenance of applications
  • Experience eliciting and documenting information from diverse business area stakeholders and subject ma