Azure Data Engineer
Date Posted: 13-Mar-2024 | Qualification: B.E/B.Tech, MCA, ME/MTech, Bsc, BCA
| Position: | Azure Data Engineer |
| Skills Required: | Azure Data Engineer, ADF, AQI |
| Employment Type: | Full Time |
| Location: | Bangalore,Hyderabad |
| Job Mode: | Hybrid |
| Experience: | 4 - 12 (years) |
Job Description:
JD Expertise with minimum 3+ projects (5+ Yrs exp.)
a) Azure SQL DB/DW
b) Experience in implementing effective database solutions and data models to store and retrieve data
c) Designing DB schema, data models on RDBMS and DW
d) Programming and optimizing DB objects Views, Stored Procs, Functions
b) Azure Data Lake or Blob storage
c) Experience working with high volume data, large objects
Expertise in design and development of Data pipelines and ETL/ELT using ADF, Databricks to move data from relational/structured/unstructured data from source to data lake to data warehouse, on Azure
a. Creating Pipelines and integrations of multiple data sources using Azure data factory and other integration technologies
b. Good to have batch and streaming (Kafka, Spark Streaming, Stream Analytics)
c. Good to have Big data processing and transformation using Databricks (Scala/Python)
d. Good to have Expertise in optimizing cost and performance of data pipelines
