Sign in to see your fit: the skills, experience and location this job asks for, checked against your profile.
Job description
Summary
We are seeking a Senior Data Engineer to architect and build modern Azure-based data solutions, lead large-scale data platform modernization initiatives, and mentor junior engineers. The ideal candidate should have deep expertise in Azure Synapse Analytics, Databricks, Azure Data Factory (ADF), and modern data engineering practices. Experience with Informatica PowerCenter is a plus but not mandatory.
Key Responsibilities
Design and implement end-to-end Azure data architectures using Azure Synapse Analytics, Databricks, and ADLS Gen2.
Lead and support data modernization and migration initiatives to Azure.
Perform solution assessment, complexity analysis, and migration planning.
Develop scalable data pipelines using PySpark, Spark SQL, and Azure Data Factory (ADF).
Implement data engineering best practices including SCD, CDC, UPSERT/MERGE, and data quality frameworks.
Optimize data processing performance, storage design, and cloud costs.
Design partitioning, data distribution, and performance tuning strategies.
Mentor team members and establish coding standards and engineering best practices.
Drive adoption of AI-assisted development tools such as GitHub Copilot to improve productivity and code quality.
Required Skills
Strong hands-on experience with:
Azure Synapse Analytics
Azure Databricks
PySpark
Spark SQL
Azure Data Factory (ADF)
Advanced SQL expertise across platforms such as:
Oracle
SQL Server
PostgreSQL
Experience with Git/GitHub, CI/CD, and Azure DevOps.Strong understanding of:
Data Warehouse Concepts
Medallion Architecture
Data Governance
Data Security (RBAC, Key Vault)
Experience designing scalable and enterprise-grade data platforms. Good to Have
Exposure to Informatica PowerCenter (IPC).
Experience with Kafka, Azure Event Hubs, or Streaming Architectures.
Terraform or Infrastructure as Code (IaC).
Power BI and Analytics solutions.
AI/ML integration with data platforms.
Domain experience in Insurance or Financial Services.
This guide is for freshers and working developers in India who use Git every day and now have to explain it in an interview: campus hires, engineers at service companies moving to product teams, and leads who review pull requests. It has 60 questions in three levels. Easy covers the staging area, commits, branches, merges and remotes. Medium covers what goes wrong at work: rebasing, conflicts, reset versus revert, lost commits, rejected and forced pushes. Hard covers Git internals, branching strategies, protected branches, merge queues, large repositories and GitHub Actions security. Every command output shown comes from running Git 2.43 on small practice repositories. Run the commands in a scratch repository of your own, then take the mock test.
Questions you may be asked
What is the difference between Git and GitHub?
What are the working tree, the staging area and HEAD?
What is the difference between git diff and git diff --staged?