Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Data Engineer IIMastercard's Data Engineering & Analytics team seeks a Lead Data Engineer to develop data & analytics solutions for vast datasets collected from various consumer-focused businesses.Your role will involve creating high-performance algorithms, cutting-edge analytical techniques, and intuitive workflows to help users derive actionable insights from big data. You will work with large-scale data sets and front-end visualizations to unlock the value of big data and support business needs through innovative data-driven solutions.
Role:
1.\tDrive the evolution of data and services platforms with a strong emphasis on data engineering and data science, ensuring impactful advancements in data quality, scalability, and efficiency.
2.\tDevelop and fine-tune methods and algorithms to generate precise, high-quality data at scale, including the creation and maintenance of feature stores, analytical stores and curated datasets for enhanced data integrity and usability.
3.\tSolve complex data challenges involving multi-layered data sets and optimize the performance of existing data pipelines, libraries, and frameworks.
4.\tProvide support for deployed data applications and analytical models, identifying data issues and guiding resolutions.
5.\tEnsure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.
6.\tIntegrate diverse data sources, including real-time, streaming, batch, and API-based data, to enrich platform insights and drive data-driven decision-making.
7.\tExperiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.
8.\tDevelop and enforce best practices for data engineering, including coding standards, code reviews, and documentation.
9.\tEnsure data security and privacy compliance, implementing measures to protect sensitive data.
10.\tCommunicate, collaborate and work effectively in a global environment.
All About You:
1.\tBachelor's degree in Computer Science, Software Engineering, or a related field
2.\tExtensive hands-on experience in Data Engineering, including implementing multiple end-to-end data warehouse projects in Big Data environments.
3.\tProficiency in application development frameworks (Python, Java/Scala) and data processing/storage frameworks (Hadoop, Spark, Kafka).
4.\tExperience in developing data orchestration workflows using tools such as Apache NiFi, Apache Airflow, or similar platforms to automate and streamline data pipelines.
5.\tExperience with performance tuning of database schemas, databases, SQL, ETL jobs, and related scripts.
6.\tExperience of working in Agile teams
7.\tExperience in development of data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale using Java, Scala, or Python. This includes all phases such as data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting analytics.
8.\tExperience in developing integrated cloud applications with services like Azure, Databricks, AWS or GCP.
9.\tExcellent analytical and problem-solving skills, with the ability to analyze complex data issues and develop practical solutions.
10.\tStrong communication and interpersonal skills, with the ability to collaborate effectively with and facilitate activities across cross-functional teams, geographically distributed, and stakeholders.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Abide by Mastercard’s security policies and practices;
Ensure the confidentiality and integrity of the information being accessed;
Report any suspected information security violation or breach, and
Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.