Job description
Key accountabilities:
Develop a deep understanding of the business domain and enterprise technology inventory to craft a solution roadmap that achieves business objectives, maximizes reuse.
Design scalable patterns and architecture to support both batch and real-time data products & platform using big data technologies such as hadoop, sql data warehouse, emr, spark, data bricks, snowflake, azure synapse or other cloud data warehousing technologies.
Ensure physical and logical data models are designed with an extensible philosophy to support future, unknown use cases with minimal rework.
Partner with it, data engineering and other teams on the administration and monitoring of all data platforms to ensure the enterprise data model incorporates key dimensions needed for the proper management: business and financial policies, security, local-market regulatory rules, consumer privacy by design principles (pii management) and all linked across fundamental identity foundations.
Drive collaborative reviews of design, code, data, security features implementation performed by data engineers to drive data product development.
Assist with data planning, sourcing, collection, profiling, and transformation.
Write requirements for etl and bi developers.
Test the effectiveness of the database before release for business use.
Show expertise for data at all levels: low-latency, relational, and unstructured data stores; analytical and data lakes; data streaming (consumption/production), data in-transit.
Develop repeatable data patterns based on cloud-centric, code-first approaches to data management and cleansing.
Work with product managers and data stewards within the enterprise data governance process to define and conceptualize data models across enterprise master data, transaction data, and informational data and implement those models into the enterprise data model.
Partner with the data science team to standardize their classification of unstructured data into standard structures for data discovery and action by business customers and stakeholders.
Design data lineage and mapping of source system data to canonical data stores for research, analysis and productization.
Lead the way in creating next-generation talent for tech, mentoring internal talent and help leadership in recruiting external talent.
Help with intake prioritization, decision making of what to pursue across a wide base of users/stakeholders and across products, databases, and services.
Qualifications/requirements
9+ years of overall technology experience that includes at least 6+ years of hands-on software development, data engineering, and systems architecture.
3+ experience with azure data factory, databricks and azure machine learning.
3+ years of experience with data lake infrastructure, data warehousing, and data analytics tools.
3+ years of experience in sql optimization and performance tuning, and development experience in programming languages like python, pyspark, scala etc.
3+ years in cloud data engineering experience in at least one cloud (azure, aws, gcp).
Experience in forecasting techniques/predictive analysis.
Experience in at least one data modelling tool (er/studio, erwin).
Experience with integration of multi cloud services with on-premises technologies.
Experience with data profiling and data quality tools like apache griffin, deequ, and great expectations.
Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
Experience with at least one mpp database technology such as redshift, synapse or snowflake.
Experience with running and scaling applications on the cloud infrastructure and containerized services like kubernetes.
Experience with version control systems like github and deployment & ci tools.
Experience with building solutions in the retail or in the supply chain space is a plus.
Understanding of metadata management, data lineage, and data glossaries is a plus.
Working knowledge of agile development, including devops and dataops concepts.
Familiarity with business intelligence tools (such as power bi).
Ba/bs in computer science, math, physics, or other technical fields.
Relocation eligible: eligible for standard relocation
Job type: regular
Hiring insights
Job activity
Posted 3 days ago
Job details Salary ₹12,00,000 a year job type full-time Qualifications Bachelor`s (required) English (preferred) Hindi (preferred) Full job description Responsibilities...
Apply For This JobThis role will be primarily responsible for managing and maintaining our product stock and inventory levelsThe candidate will work closely...
Apply For This JobTransunion`s job applicant privacy notice what we`ll bring: the role will be responsible for assisting in formulating and managing the...
Apply For This JobJob details Job type full-time internship fresher Full job description Role: intern/ trainee Qualification: any graduate Modules : – Role...
Apply For This JobLooking for experienced work-at-home MTs for pathology and radiology transcription. Early morning/Afternoon shift. Excellent pay (per report basis). Experienced full...
Apply For This JobJob Title: Analyst/Senior Analyst Location: Bangalore, India Role Description: Lending Operations in Bangalore is responsible in managing Lifecycle events on...
Apply For This Job