As a Sr Data Engineer within the RSS team based in Visa’s Bangalore office, you will play a pivotal role in driving the design, development, and implementation of analytics-driven strategies and high-impact solutions for Visa clients. Leveraging your deep expertise in banking and payments, you will address complex problems and unlock significant business value.
Key Responsibilities
- Develop, maintain, and support scalable big data ETL pipelines using technologies such as Hadoop, Hive, and Spark.
- Ensure the security, timeliness, and quality of data through robust implementation and testing of distributed systems.
- Support production systems and collaborate closely with other engineers to design and develop efficient ETL pipelines.
- Work with product managers to understand and clarify requirements, contributing to the development of effective data solutions.
- Engage in continuous learning and professional development to stay abreast of industry advancements.
Qualifications
Basic Qualifications
- Bachelor’s Degree with 2+ years of relevant work experience or an Advanced Degree (e.g., Master’s, MBA, JD, MD, PhD).
Preferred Qualifications
- 5+ years of experience with a Bachelor’s degree or 4+ years with a Master’s/Advanced degree in a related analytical field (e.g., Computer Science, Statistics, Finance, Economics).
- Proficiency in the Hadoop ecosystem and associated technologies, such as Apache Spark.
- Experience writing Spark and Hive code for processing large datasets.
- Strong SQL skills for big data processing.
- Development experience in Scala, Python, or Java.
- Basic Unix/Shell or Python scripting experience.
- Familiarity with scheduling tools like Airflow or Control-M.
- Experience with version control systems such as Git.
- Basic understanding of RDBMS like MS SQL, DB2, Oracle.
- Knowledge of Kafka and Apache Hudi is a plus.
Additional Information
Visa is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local laws.