We are looking for a Senior Data Engineer with deep hands-on expertise in PySpark, Databricks, and distributed data architecture. This individual will play a lead role in designing, developing, and optimizing data pipelines critical to our Ratings Modernization, Corrections, and Regulatory implementation programs under PDB 2.0. The ideal candidate will thrive in fast-paced, ambiguous environments and collaborate closely with engineering, product, and governance teams.

• Design, develop, and maintain robust ETL/ELT pipelines using PySpark and Databricks.

• Own pipeline architecture and drive performance improvements through partitioning, indexing, and Spark optimization.

• Collaborate with product owners, analysts, and other engineers to gather requirements and resolve complex data issues.

• Perform deep analysis and optimization of SQL queries, functions, and procedures for performance and scalability.

• Ensure high standards of data quality and reliability via robust validation and cleansing processes.

• Lead efforts in Delta Lake and cloud data warehouse architecture, including best practices for data lineage and schema management.

• Troubleshoot and resolve production incidents and pipeline failures quickly and thoroughly.

• Mentor junior team members and guide best practices across the team.

• • Bachelor's degree in Computer Science, Engineering, or a related technical field.

  • 6+ years of experience in data engineering or related roles.

  • Advanced proficiency in Python, PySpark, and SQL.

  • Strong experience with Databricks, BigQuery, and modern data lakehouse design.

  • Hands-on knowledge of Azure or GCP data services.

  • Proven experience in performance tuning and large-scale data processing.

  • Strong communication skills and the ability to work independently in uncertain or evolving contexts

What we offer you

• Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.

• Flexible working arrangements, advanced technology, and collaborative workspaces.

• A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.

• A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.

• Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.

• Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.

• We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women’s Leadership Forum.

At MSCI we are passionate about what we do, and we are inspired by our purpose – to power better investment decisions. You’ll be part of an industry-leading network of creative, curious, and entrepreneurial pioneers. This is a space where you can challenge yourself, set new standards and perform beyond expectations for yourself, our clients, and our industry.

MSCI is a leading provider of critical decision support tools and services for the global investment community. With over 50 years of expertise in research, data, and technology, we power better investment decisions by enabling clients to understand and analyze key drivers of risk and return and confidently build more effective portfolios. We create industry-leading research-enhanced solutions that clients use to gain insight into and improve transparency across the investment process.

MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, gender, gender identity, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy (including unlawful discrimination on the basis of a legally protected parental leave), veteran status, or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for any part of the application process, please email Disability.Assistance@msci.com and indicate the specifics of the assistance needed. Please note, this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.

To all recruitment agencies

MSCI does not accept unsolicited CVs/Resumes. Please do not forward CVs/Resumes to any MSCI employee, location, or website. MSCI is not responsible for any fees related to unsolicited CVs/Resumes.

Note on recruitment scams

We are aware of recruitment scams where fraudsters impersonating MSCI personnel may try and elicit personal information from job seekers. Read our full note on careers.msci.com