Senior Software Engineer – LLM

Job Category: Information Technology (IT)
Job Type: Full Time
Job Location: United States
Salary: $214K/yr - $327.8K/yr
Company Name: Snowflake

Company Overview

Snowflake delivers the AI Data Cloud — a global network where thousands of organizations mobilize data with near-unlimited scale, concurrency, and performance. Inside the AI Data Cloud, organizations unite their siloed data, easily discover and securely share governed data, and execute diverse analytic workloads. Wherever data or users live, Snowflake delivers a single and seamless experience across multiple public clouds. Snowflake’s platform is the engine that powers and provides access to the AI Data Cloud, creating a solution for data warehousing, data lakes, data engineering, data science, data application development, and data sharing. Join Snowflake customers, partners, and data providers already taking their businesses to new frontiers in the AI Data Cloud.

About the job

Build the future of the AI Data Cloud. Join the Snowflake team.

The Snowflake Machine Learning Platform team’s mission is to enable customers to bring their machine learning and deep learning workloads to Snowflake. Our customers want to build powerful models with the ever increasing data in Snowflake but face several challenges including infrastructure optimizations, orchestration, performance and security. The team aims to solve these challenges by building highly integrated platform solutions that are simple, secure and enable end to end workflows. We are on an early journey to build the most scalable machine learning and data platform without sacrificing the benefits of a single platform and governance.

We are looking for outstanding technical leaders who will play a pivotal role in this journey by understanding Snowflake’s core platform architecture and evolving it to enable state of the art machine learning workloads, including LLMs. Join us to define strategies, set technical directions, design and execute, engage and deliver innovation and unlock the power of AI for thousands of enterprise customers. This position is based in Bellevue, WA or San Mateo, CA.

RESPONSIBILITIES:

  • Help define and own the roadmap, working collaboratively and proactively with senior architects, PMs and team leadership. The initiatives include platforms and tools that enable customers to do state of the art machine learning on Snowflake natively.
  • Collaboratively develop distributed training infrastructure to train and fine tune LLMs
  • Work on inference optimizations to efficiently serve LLMs
  • Create alignment in RHLF for LLMs
  • Collaborate across other engineering partner teams to continuously improve LLM development velocity and capabilities at Snowflake.
  • Support team members in delivering a high level of technical quality.

IDEAL REQUIREMENTS & QUALIFICATIONS:

  • Have 8+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services and frameworks.
  • Experience modeling in pre-training & fine tuning foundation models
  • Strong track record of working with machine learning systems and/or platforms.
  • Experience with several of the following frameworks: SKLearn, XGBoost, PyTorch, Tensorflow.
  • Fluent in Python. C++ and Java experience is a plus.
  • Have worked well with data scientists, business analysts and machine learning infrastructure to connect the dots between business and technology partners.
  • BS/MS/PhD in Computer Science or related majors, or equivalent experience
    APPLY

Apply for this position

Allowed Type(s): .pdf, .doc, .docx