Data Engineer- Experience with designing triggers, activities and integrating various runtimes like Azure, Self- hosted, SSIS etc.
Description
Experience: 2-7 Years
Skills to have:
- Expertise in working with Azure cloud services likeADF, ADLS, Event hub, etc.
- Need knowledge of data modeling, database design and complex query building
- Hands-on experience to ingest data from various sources to Azure data lake using Azure Data Factory.
- Experience with designing triggers, activities and integrating various runtimes like Azure, Self- hosted, SSIS etc
- Experience in writing and optimizing Spark code.
- Strong knowledge in working with complex SQL queries and UNIX scripts.
- Good to have knowledge on Snowflakes, Snowpipe, SnowSQL.
- Have experience in working with Agile Framework
- Good to have knowledge on streaming data ingestion and transformation using Kafka/Azure Stream analytics.
- Good to have knowledge on working with languages like python or Scala
Job Responsibility for Data Engineer:
- Design ingestion pipelines using ADF including Integration runtimes, triggers, activities, etc.
- Data modeling, database design and complex query building
- Ingest data from various sources to data lake using Azure Data Factory.
- Perform transformations using Databricks Spark.
- Constantly learn and work on new technologies
Position
Data Engineer
Salary
7 – 15 Lakh/Year INR
Expertise
- Python
- SQL
- Azure
- Apache Spark
- Data Engineer – 3 years
- microsoft azure AI
- Payroll
- Fully Remote
- India
Originally Published At
Share this:
Share with
