Awign Looking for Data Engineer at Bengaluru, Karnataka, India Full Time

We are seeking an experienced and highly motivated individual to join our team as a Consultant – in the Big Data and Analytics domain. The ideal candidate should have 5-7 years of hands-on experience in Big Data technologies such as Hive, Impala, and Oozie, as well as proficiency in Spark/Scala and SQL.

Responsibilities

• Big Data Processing:
• Develop and maintain scalable and high-performance data processing pipelines using Big Data technologies like Hive, Impala, and Oozie.
• Work on optimizing and fine-tuning existing data processing workflows for efficiency.
• Spark/Scala Development:
• Design and implement Spark-based solutions for data processing and analytics.
• Collaborate with cross-functional teams to integrate Spark applications into our data ecosystem.
• SQL Expertise:
• Utilize strong SQL skills to query, analyze, and extract insights from large datasets.
• Design and optimize SQL queries for complex data retrieval and reporting.
• Data Modeling:
• Contribute to the design and implementation of data models that support business requirements.
• Ensure data accuracy, consistency, and integrity across various databases.
• Team Leadership:
• Provide technical leadership to a team of data engineers and analysts.
• Mentor team members and foster a collaborative and innovative work environment.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Proven experience (5-7 years) in designing, developing, and maintaining Big Data solutions.
• Strong proficiency in Spark/Scala for large-scale data processing.
• Expertise in SQL with the ability to write complex queries for data analysis.
• Familiarity with data warehousing concepts and ETL processes.
• Excellent communication and leadership skills.

Additional Skills (Preferred)

• Experience with cloud platforms (e. g., AWS, Azure, GCP).
• Knowledge of data visualization tools (e. g., Tableau, Power BI).
• Strong problem-solving skills and the ability to work in a fast-paced environment.

This job was posted by Praveen Sah from Awign.