Data Engineer
Apply now »Date: Sep 20, 2024
Location: Pune, MH, IN, 411001
Company: Lubrizol Corporation
About Lubrizol
The Lubrizol Corporation, a Berkshire Hathaway company, is a specialty chemical company whose science delivers sustainable solutions to advance mobility, improve wellbeing and enhance modern life. Founded in 1928, Lubrizol owns and operates more than 100 manufacturing facilities, sales, and technical offices around the world and has about 8,000 employees. For more information, visit www.Lubrizol.com.
We value diversity in professional backgrounds and life experiences. By enabling a consistent, unbiased, and transparent recruitment process, Lubrizol seeks to create a positive experience for candidates so we can get to know them at their best. We recognise unique work and life situations and offer flexibility, ensuring our employees feel engaged and fulfilled in every aspect of life.
Summary of the Role:
This role will design, develop, and maintain the data processing platform on Azure. The purpose of the data platform is to integrate data across the organization to empower and provide business partners, vendors, and customers with actionable insights. The right candidate will implement best practices using expertise in Azure Data Services to build a scalable, secure, and governed platform.
Responsibilities:
• Develop pipelines in Synapse that ingest data from a growing number of data sources.
• Implement data quality checks and validation processes to ensure accuracy, consistency, and integrity.
• Identify, design, and integrate process improvements: automate manual processes, timely data delivery, and re-designing for future use cases.
• Monitor pipeline operations, tasks, resource utilization, and failures.
• Support HA, DR, Backup, and retention policies on all data platforms Ensure compliance with IT General Controls, provide needed information in support of audits and to substantiate process and controls compliance.
• Produce documentation for data models, transformations, business rules, and lessons learned that allows other staff members to understand the ingestion process and maintain and troubleshoot it
• Understand technical requirement of project and execute in data platform
Requirements (education, experience, competencies and specific job requirements):
• 7 years of IT experience in Data and Analytics, data integration or data ingestion.
• 3+ years of experience in Azure Cloud Services (PaaS & IaaS), Azure Data Factory, Azure Synapse Analytics, Azure Analysis Service, Application Insights, Azure Monitoring, Azure Data Lake.
Education / Certification:
• Bachelor's degree in computer science.
• Certifications considered a plus, especially those focused on data and analytics
Experience and Skills:
• Collaborations across Data intelligence cross functional team
• Good experience in tracking and logging end to end software application build using Azure Dev Ops.
• Having Data warehousing experience in Business Intelligence Technologies and Database with Extensive Knowledge in Data analysis, TSQL queries, ETL and ELT process, Reporting services using (Power BI).
• Design Enterprise level data warehouse solutions
• Have good experience designing cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and designing tabular models in Azure analysis services.
• Have extensive experience in creating pipeline jobs, schedule triggers using Azure data factory.
• Proven ability in performance Tuning, Query Optimization
• Involved in full life cycle of software design process of projects including prototyping, proof of concepts, design interface implementation, testing and maintenance.
• Good experience in maintaining version control using Azure Dev Ops.
• Knowledge of SAP source system and BW is a plus.
• Emotional intelligence, flexible work style, and excellent diplomatic skills across all levels of an organization
• Proven oral and written communication skills with a high degree of comfort with varying types of audiences.
• Experience designing and delivering complex solutions on time and with expected quality.
Ready for your next career step? Apply today and let's shape the future together!
It’s an exciting time to be part of Lubrizol. Lubrizol is not staying put. We are continually learning and evolving. Our passion delivers our success — not only for Lubrizol but for those who count on us every day: our employees, customers and communities.
We work with a relentless commitment to operate safely and responsibly, keeping safety, sustainability, ethics, and compliance at the forefront of everything we do. The well-being of our employees, customers and communities is paramount to our culture and in the way we approach our work.
As a diverse, global team, we work together to solve some of the world’s most pressing challenges. We impact everyday lives through science only Lubrizol can deliver, and we never stop pushing to do it better.
One of the founding principles of The Lubrizol Corporation more than 90 years ago was treating every employee with dignity and respect. That same commitment is only stronger today.
More than that, we are committed to providing an environment where every employee can be the best they can be, no matter their ethnic origin, religion, sex, national origin, sexual orientation, gender identity, disability or any other characteristic.
Job Segment:
Cloud, Manufacturing Engineer, Testing, Database, Data Warehouse, Technology, Engineering