Azure Databricks

Company Description

We are an Artificial Intelligence (AI) focused product engineering company, providing our customers in healthcare, retail & e-commerce, manufacturing, and hospitality sectors with cutting-edge products & solutions, harnessing Big Data Analytics, Vision Analytics, and IoT.

Ever since our inception in March 2010, Tech Vedika has been

• Great Place To Work Certified™(May 2022-May 2023) Organization 
• Top 50 I Mid-Size India’s Best Workplaces for Women 2022 !
• Top 10 Most Disruptive Face & Image Recognition Solution Providers’2020 – Analytics Insights
• Top 10 Healthcare Analytics Solution Providers’ 2019- Healthcare Outlook Magazine
• Top 20 most amazing AWS Service Providers – CIO Review India 2018

We strive for simple, elegant tech solutions to perform complex tasks. As a scalable technology partner, we enable organizations to improve operational efficiency and unleash new business potential

Job Description

Data Engineer – Azure Databricks & SQL

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Azure Databricks and SQL to join our growing data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and supporting the migration of legacy data platforms into Azure Databricks.

The role requires hands-on experience in data warehousing, ETL development, data modeling, and Azure cloud technologies.

Key Responsibilities

• Design, develop, and maintain scalable ETL/data pipelines.
• Build and optimize batch and streaming data processing solutions using Databricks and Apache Spark.
• Support migration of legacy data platforms into Azure Databricks.
• Develop and maintain enterprise data warehouse solutions.
• Create and optimize SQL queries for large-scale datasets.
• Implement data models including dimensional modeling and star schema design.
• Work with Azure Data Factory (ADF), SSIS, and related ETL tools.
• Manage data governance, lineage, and security using Unity Catalog.
• Implement CI/CD pipelines using Git and Azure DevOps.
• Ensure data quality, reliability, performance, and compliance standards.
• Collaborate with cross-functional teams including BI, analytics, and business stakeholders.
• Stay updated with latest Databricks and Azure platform enhancements.

Required Skills

• 5–8 years of experience as a Data Engineer.
• Strong hands-on experience in SQL development and performance tuning.
• Extensive experience with Azure Databricks and Apache Spark.
• Strong experience in Data Warehousing and Data Modeling.
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Databricks
  • SSIS
  • ETL Development
• Experience with Unity Catalog for governance and security.
• Knowledge of Azure Data Lake and Azure Storage.
• Experience building both batch and streaming pipelines.
• Familiarity with Azure DevOps, Git, and CI/CD processes.
• Good understanding of data governance and security best practices.
• Power BI knowledge is an added advantage.
• Excellent communication and problem-solving skills.

Preferred Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related field.
• Experience working in enterprise-scale cloud data platforms.
• Exposure to Agile methodologies.

Qualifications

Additional Information

At Tech Vedika, we are looking for talented individuals who want to work with driven people. Attain success while working on interesting projects with a culturally diverse group of individuals.

Perks & Benefits: 

• Health Insurance
• Meal Vouchers
• Learning Aids
• Client/Customer Interactions
• Working with great minds 

If you want an exciting and dynamic career with unlimited growth potential, then Tech Vedika is the place for you!