Data Engineer

The Chevron Engineering and Innovation Excellence Center (ENGINE) in Bengaluru India brings together the resources and expertise of the Chevron global network with talent in India to enhance agility and technological innovation to optimize solutions for the world’s current and future energy challenges.  As one of the leading energy providers worldwide, Chevron is involved in the production of crude oil and natural gas, manufacturing of transportation fuels, lubricants, petrochemicals, and additives, and the development of enabling technologies. Chevron's vision is to be the global energy company most admired for its people, partnerships, and performance. With a clear purpose to develop affordable, reliable, ever-cleaner energy that enables human progress, we believe human ingenuity has the power to solve any challenge and overcome any obstacle. Meeting the world’s growing energy needs requires the pursuit of innovations and advancements that deliver a better future for all. About the position: Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Senior Data Engineer designs and oversees the entire data infrastructure, data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. The expectation for this role is 3-6 years of relevant experience. Key responsibilities: Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency. Mentor junior data engineers within the organization. Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric). Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage). Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize data pipelines in the Azure environment for performance, scalability, and reliability. Ensure data quality and integrity through data validation techniques and frameworks. Develop and maintain documentation for data processes, configurations, and best practices. Monitor and troubleshoot data pipeline issues to ensure timely resolution. Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge. Manage the CI/CD process for deploying and maintaining data solutions. Required Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals. At least 5 years of proven experience as a Data Engineer or similar role dealing with data and ETL processes. 3-6 years of experience Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2. Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL). Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing). Experience with big data technologies (e.g., Spark). Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills. Preferred Qualifications: Strong experience in Python is preferred but experience in other languages such as Scala, Java, C#, etc is accepted. Experience building spark applications utilizing PySpark. Experience with file formats such as Parquet, Delta, Avro. Experience efficiently querying API endpoints as a data source. Understanding of the Azure environment and related services such as subscriptions, resource groups, etc. Understanding of Git workflows in software development. Using Azure DevOps pipeline and repositories to deploy and maintain solutions. Understanding of Ansible and how to use it in Azure DevOps pipelines. What we can offer you Everything we do at Chevron is guided by our values and our commitment to The Chevron Way . Have the opportunity to take part in world-leading energy projects, advance your professional development and expand your career within an inclusive and collaborative workplace. Join a workplace where innovation, collaboration and safety are at the core of how we work. Work in thoughtfully designed environments that support focus, well-being, and innovation enhanced by digital tools that enable seamless collaboration. Grow through structured learning, mentorship, and opportunities to contribute to impactful projects that align with Chevron’s values and business priorities. Access comprehensive benefits that support your health, well-be