Azure Data Engineer
Department: Software
Project Location(s): Bengaluru, Karnataka,India
Education: Bachelor of Engineering
Responsibilities
- Designing, building, and maintaining scalable data pipelines and data processing systems on Azure.
- Developing ETL processes to extract, transform, and load data from various sources into Azure data storage solutions.
- Working with data scientists and analysts to understand data requirements and provide data solutions.
- Optimizing and tuning data solutions for performance and scalability.
- Implementing data security and governance practices to ensure data integrity and privacy.
- Collaborating with cross-functional teams to integrate data solutions into business applications.
- Providing technical guidance and support to junior team members.
- Keeping up-to-date with Azure data technologies and industry trends.
- Participating in data architecture design and planning sessions.
- Troubleshooting data-related issues and providing timely resolutions.
Skills/Experience
- Proficiency in Microsoft Azure cloud platform, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics (formerly SQL Data Warehouse).
- Experience with big data technologies such as Apache Hadoop, Apache Spark, and Apache Kafka.
- Strong knowledge of SQL and database design.
- Familiarity with data modeling and data warehousing concepts.
- Experience with ETL (Extract, Transform, Load) processes and tools.
- Knowledge of programming languages such as Python, Scala, or R for data manipulation and analysis.
- Understanding of data governance and security practices.
- Familiarity with machine learning concepts and tools.
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork skills.