Azure Data Engineer

Job Description

Azure Data Engineer, you'll be responsible for designing, implementing, and managing data solutions on the Azure platform.

‍Responsibilities

• To meet data processing and analytics requirements, design and create SQL queries, stored procedures, functions, and views.

• To make SQL code for data extraction, transformation, and loading operations as efficient as possible, collaborate closely with data engineers and data scientists.

• To ensure effective data retrieval and processing, troubleshoot and optimize database performance.

• Design and maintain data models in conjunction with the data engineering team to ensure consistency and integrity of the data.

• Create and keep up with documentation for database schemas, data models, and SQL code.

• Developing, managing, and optimizing robust and reliable data pipelines using azure native capabilities.

• Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc.

• Creating architecture for data solutions with high performance characteristics Bringing data and analytics products to production.

 Requirements

• Should have minimum of 2+ years of experience in Cloud Data Engineering

• Experience with Azure cloud Platform (mandatory).

• Must have Python experience as a data Engineer.

• Provide technical expertise in the design and development using Azure Cloud

• Should have Built pipelines on Azure Data factory and related component.

• Programming on Databricks using both SQL and Python.

• Should have good understanding of SQL. Well versed with SQL quires

• Creating and configuring Database.

• Experience in using Azure services and tools to ingest, egress, and transform data from multiple sources.

• In-depth technical knowledge of tools like Azure Data Factory, Azure Data bricks, Azure storage, Azure Synapse etc.

• Delivered ETL solutions including data extraction, transformation, cleansing, data integration and data management.

• Designed ingestion layer for structured & unstructured data & implement specific data model for business & analytics use.

• Implemented batch & near real-time data ingestion pipelines.

‍Benefits

• Career Development

• Competitive Salary

• Flexible Hours

• Health Insurance

• Performance based Rewards