Azure Data Engineer - Raleigh, NC (Hybrid)

Position: Azure Data Engineer
Location: Raleigh, NC (Hybrid)
Duration: 6 Months

JOB DESCRIPTION:


Client Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable Client businesses to generate insights, and value to its customers. The team is the center of excellence in data engineering in Client and plays a key role in data enablement through multiple data stores, supporting different kind of analytical use cases to be able to derive predictive, prescriptive, and descriptive insights.


The Azure Data Engineer III serves as big data development expert within the data analytics engineering organization of Client Data & Analytics. This position has the responsibility of building ETL, data warehousing and reusable components using cutting edge big data and cloud technologies. The resource will collaborate with the business systems analyst, technical leads, project managers and business/operations teams in building data enablement solutions across different LOBs and use cases.



Key Responsibilities:


Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes
Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.
Develop quality code with thought through performance optimizations in place right at the development stage.
Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements.



Essential Business Experience and Technical Skills:


Ingesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ETL code Strong
Strong analytic skills related to working with unstructured datasets
Strong experience in building/designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases)
Ability to interact with business analysts and functional analysts in getting the requirements and implementing the ETL solutions.



Required:
6+ years of solutions development and delivery experience
6+ years of leadership experience in delivery of enterprise scale technology programs
Hands on expertise in: Azure SQL Synapze, Cosmos DB, Data Factory, Python, Spark Scala experience is a MUST
Building and Implementing data ingestion and curation process developed using Cloud data tools such as Azure SQL Synapze, Cosmos DB, Data Factory, Spark(Scala/python), Data bricks, Delta lake etc. should have Unity Catalogue experience.
Ingesting huge volumes data from various platforms for Reporting, Analytics, Data Supply, and Transactional (Operational data store and APIs) needs.
Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance."

Best Regards,

Vishal

[email protected]

Truth Lies in Heart