K20s – Kinetic Technologies Private Limited Looking for Data Engineer at Navi Mumbai, Maharashtra, India Full Time

Exp : 5-7 years

Type : Contractual

Location : Remote

Job Description

Role Overview:

We are seeking an experienced and highly motivated Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure for our client, a prominent Audit and Consulting firm. Your expertise in data processing, integration, and optimization will contribute to the firm’s data-driven decision-making processes. This is a remote position, allowing you to work independently while collaborating with a dynamic team.

Responsibilities

• Collaborate with cross-functional teams to understand data requirements and objectives, translating them into efficient data pipeline designs.
• Develop, test, and maintain scalable data pipelines that collect, transform, and load data from various sources, ensuring data accuracy and reliability.
• Implement data integration and ETL processes, adhering to best practices for data quality and performance.
• Optimize data pipelines for performance and efficiency, addressing potential bottlenecks and ensuring scalability as data volumes grow.
• Work with large datasets, both structured and unstructured, while implementing appropriate data processing techniques.
• Ensure data security and compliance with relevant data privacy regulations throughout the data pipeline.
• Troubleshoot data pipeline issues, identifying root causes and implementing solutions in a timely manner.
• Collaborate with data analysts and scientists to provide them with the required data in a format conducive to analysis.
• Stay updated with industry trends and emerging technologies in data engineering, recommending and implementing improvements accordingly.

Qualifications

• Bachelor’s or higher degree in Computer Science, Information Technology, or a related field.
• Proven 5-7 years of experience as a Data Engineer, working with complex data integration and processing projects.
• Strong proficiency in programming languages such as Python, Java, or Scala, and experience with ETL frameworks.
• In-depth knowledge of SQL and experience with database systems such as MySQL, PostgreSQL, or similar.
• Hands-on experience with data pipeline orchestration tools like Apache Airflow, Luigi, or similar.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud, and their respective data services.
• Experience with big data technologies such as Hadoop, Spark, or Kafka is a plus.
• Strong understanding of data modeling, data warehousing concepts, and data architecture principles.
• Excellent problem-solving skills with a keen attention to detail, particularly in identifying data-related issues.
• Effective communication skills, with the ability to collaborate in a remote work environment.
• Prior experience within the Audit and Consulting domain is advantageous but not mandatory.
• Demonstrated ability to handle confidential and sensitive information with discretion.

Skills: optimization,performance,integration,database systems,python,big data technologies,google cloud,java,data modeling,mysql,spark,data analysis,data engineer,azure,troubleshooting,luigi,data security,data pipeline orchestration tools,compliance,scala,communication skills,data pipelines,cloud platforms,postgresql,kafka,data architecture principles,remote work environment,data warehousing concepts,etl processes,hadoop,problem-solving skills,industry trends,etl frameworks,data services,aws,data privacy regulations,emerging technologies,apache airflow,audit and consulting domain,sql,programming languages,data quality,data processing