Software Engineer, Data Foundation – USDS

About the Team

The TikTok U.S. Data Security (USDS) team is responsible for the security, integrity, and compliance of TikTok’s data within the United States. The Data Platform Team builds a scalable, reliable, cost-efficient infrastructure that ensures data integrity and empowers every business unit to win through self-service tools and scientific insights.

We are seeking a Software Engineer to contribute to efficiency, stability, and AI-driven innovation initiatives. You will work alongside senior engineers to optimize the performance and efficiency of our core data engines—Apache Spark, Kafka, ClickHouse, and Doris—while helping build AI-powered solutions that enhance platform intelligence, automate operations, and drive cost optimization at a petabyte scale.

Responsibilities

Performance & Efficiency

• Assist in optimizing Apache Spark performance and resource utilization for large-scale data processing.
• Participate in enhancing ClickHouse and Doris OLAP systems through query tuning and storage-compute optimization.

Platform Intelligence & Automation

• Contribute to automated job diagnosis and failure analysis systems using AI/ML techniques.
• Help build and maintain monitoring and self-healing capabilities for data pipelines.
• Develop features for intelligent tools.

Stability & Operational Excellence

• Support the development of robust disaster recovery and data integrity mechanisms.
• Assist in integrating AI/ML capabilities to improve developer productivity and platform efficiency.

Engineering & Collaboration

• Work closely with senior engineers to deliver high-quality, maintainable code and system designs.
• Engage in code reviews, write technical documentation, and actively learn new technologies across distributed systems and AI.

Minimum Qualifications

• Education: BS/MS in Computer Science, Engineering, or a related technical field.
• Distributed Systems: 1+ years of hands-on experience building or maintaining distributed systems.
• Coding: Strong proficiency in standard programming languages such as Java, Scala, C++, or Python.

Preferred Qualifications

• Solid understanding and practical experience with modern big data technologies (e.g., Apache Spark, ClickHouse, Doris, or similar engines).