Insight Global is seeking an experienced Azure Data Engineer to join our team for a full-time, ongoing contract opportunity. The ideal candidate will have 5+ years of experience working with cloud-native data services and platforms. This role involves working with a variety of Azure services to build and manage ETL pipelines, data storage solutions, and analytical reporting systems. The position offers a competitive salary and Indian benefits, with the expectation that candidates can start immediately or within a 30-day notice period.
Key Responsibilities
- Design, develop, and manage ETL pipelines for data extraction, transformation, and loading.
- Build and maintain data storage solutions, ensuring data integrity and quality.
- Work with cloud-native data services such as Azure Data Factory, Azure Data Bricks, Azure Data Lake, Synapse, and Snowflake.
- Implement and manage data lakes and data pipelines using Azure technologies.
- Utilize Python scripting for data processing and automation.
- Leverage SQL databases and other big data technologies like Hadoop, Apache Hive, and Kafka.
- Build and manage data visualizations using PowerBI and Tableau.
- Work with clients and team leads to understand and adapt to requirements.
- Provide production-level support for labs and sandbox services.
- Lead a team of engineers, making critical decisions and serving as the subject matter expert.
Additional Responsibilities
- Use continuous integration tools such as Jenkins and GitLab.
- Apply data modeling and transformation techniques.
- Ensure effective communication and time management.
Qualifications
Experience
- Minimum of 5 years of experience as an Azure Data Engineer.
- Proven experience with Azure Data Factory, Data Bricks, Data Lake, and other related technologies.
- Strong background in Python scripting and SQL databases.
- Familiarity with big data technologies (Hadoop, Apache Hive, Redshift, Kafka, Apache Spark).
Technical Skills
- Proficiency in Azure Cloud Data Service Offerings: Kafka, ADF, ADLS Gen2, Databricks, PowerBI, Tableau, Snowflake.
- Experience in building and managing ETL pipelines and data storage solutions.
- Understanding of data ingestion architecture, processes, and best practices.
Soft Skills
- Excellent communication and time management skills.
- Strong leadership capabilities and the ability to make critical decisions under pressure.
Compensation & Benefits
- Salary. 10-20 LPA, potentially up to 25 LPA.
- Benefits. Indian benefits included, with the potential for flexible working conditions.
Application Process
- Notice Period. Immediate or within 30 days.
- Application. Submit your application with your relevant skills and experience listed in your resume.