Senior AI Infra Engineer, TikTok E-commerce Algorithm Architecture & Engineering

About the Team

We are the TikTok E-commerce Algorithm Architecture & Engineering team (USDS). Our mission is to supercharge the efficiency and effectiveness of e-commerce algorithm services. We build user-friendly tools, elegant architecture, and robust, high-performance systems that drive GMV growth for TikTok E-commerce. Join us in building the most advanced e-commerce LLM/ML system & infrastructure in the industry.

Responsibilities

• System Architecture & Implementation: Lead the design, implementation, and operation of scalable, reliable, and high-performance ML/LLM infrastructure and systems.
• Cross-Functional Collaboration: Partner effectively across various teams, organizations, and internal/external stakeholders to drive complex engineering efforts and align technical strategies.
• Innovation: Drive technical innovation by identifying and integrating emerging technologies and novel ideas to keep our infrastructure at the cutting edge.

Minimum Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline.
• 3+ years of hands-on experience building, training, and deploying complex and scalable Machine Learning systems.
• Strong foundation in Computer Science, including algorithms, data structures, and software design patterns. Excellent problem-solving abilities.
• Solid programming skills with a strong understanding of ML/LLM system internals.
• Proven experience in managing technical projects and delivering results.

Preferred Qualifications

• In-depth experience with Large Language Model (LLM) systems and infrastructure.
• Proficiency with high-performance LLM serving frameworks (e.g., vLLM, SGLang).
• Deep understanding of the full LLM serving stack and end-to-end inference optimization (latency, throughput, memory management).