Senior Azure Data Engineer

Job Title: Senior Azure Data Engineer Location: Hyderabad Job Type: Full-Time Job Summary: As an Azure Data Engineer, you will design, build, and maintain data solutions on Microsoft Azure, leveraging your expertise in SQL and MySQL to ensure high-quality data availability for analysis and reporting. You will collaborate closely with cross-functional teams to meet data needs and enhance decision-making capabilities. Key Responsibilities: Data Pipeline Development: Design and implement ETL processes using Azure Data Factory and Azure Databricks, ensuring data integration from various sources. Database Management: Develop and maintain relational databases using SQL and MySQL, ensuring optimal performance and reliability. Data Modelling: Create and maintain data models to support analytical needs, ensuring data is structured for efficient querying and reporting. Query Optimization: Write and optimize complex SQL queries for data retrieval and reporting, improving performance and efficiency. Collaboration: Work with data scientists, analysts, and business stakeholders to understand data requirements and ensure data quality. Security and Compliance: Implement data governance practices and ensure compliance with data protection regulations. Documentation: Create and maintain comprehensive documentation for data pipelines, databases, and architectural designs. Qualifications: Bachelor’s degree 4+ years of experience in data engineering or related roles. Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, Azure SQL Database. Familiarity with AWS services will be advantageous in our multi-cloud environment. Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation. Familiarity with programming languages such as Python or spark for data processing and analysis. Understanding of data warehousing concepts and big data technologies (e.g., Hadoop, Spark) is a plus. Experience with data governance and data quality best practices. Excellent problem-solving skills and attention to detail. Strong communication skills and ability to work collaboratively in a team environment. Preferred Qualifications: Microsoft Azure Data Engineer certification. Experience with real-time data processing and stream analytics. Knowledge of machine learning concepts and tools.