Azure Data Engineer

Department: Software
Project Location(s): Bengaluru, Karnataka,India
Education: Bachelor of Engineering

Responsibilities

 

  • Designing, building, and maintaining scalable data pipelines and data processing systems on Azure.
  • Developing ETL processes to extract, transform, and load data from various sources into Azure data storage solutions.
  • Working with data scientists and analysts to understand data requirements and provide data solutions.
  • Optimizing and tuning data solutions for performance and scalability.
  • Implementing data security and governance practices to ensure data integrity and privacy.
  • Collaborating with cross-functional teams to integrate data solutions into business applications.
  • Providing technical guidance and support to junior team members.
  • Keeping up-to-date with Azure data technologies and industry trends.
  • Participating in data architecture design and planning sessions.
  • Troubleshooting data-related issues and providing timely resolutions.

 

Skills/Experience

 

  • Proficiency in Microsoft Azure cloud platform, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics (formerly SQL Data Warehouse).
  • Experience with big data technologies such as Apache Hadoop, Apache Spark, and Apache Kafka.
  • Strong knowledge of SQL and database design.
  • Familiarity with data modeling and data warehousing concepts.
  • Experience with ETL (Extract, Transform, Load) processes and tools.
  • Knowledge of programming languages such as Python, Scala, or R for data manipulation and analysis.
  • Understanding of data governance and security practices.
  • Familiarity with machine learning concepts and tools.
  • Excellent problem-solving and analytical skills.
  • Strong communication and teamwork skills.