Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
N

Senior Staff Engineer – PyTorch Accelerator

Net2Source
🇺🇸 United States
On-site
Staff / Principal
1 week ago
$90 – $96 / hour
  • PyTorch
  • AI
  • triage
  • Python
  • C++
  • Linux
  • CMake
  • GitHub
  • Triton
  • vLLM
1 week ago
Auto apply with Likeremote
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV
Join a Global Leader in Workforce Solutions – Net2Source Inc.
Who We Are
Net2Source Inc. isn't just another staffing company, we're a powerhouse of innovation, connecting top talent with the right opportunities. Recognized for 300% growth in the past three years, we operate in 34 countries with a global team of 5,500+. Our mission? To bridge the talent gap with precision—Right Talent. Right Time. Right Place. Right Price.

Title: Senior Staff Engineer – PyTorch Accelerator
Duration: 6 months (Highly possible to be extended up to 18 months)
Location: San Jose, CA (Fully onsite) …Relocation is fine if they can relocate on their own expenses and can work fully onsite in San Jose.
 
Interview: 2 to 3 rounds
 
Need to be hired as early as possible.

JOB DESCRIPTION:

Position: Senior Staff Engineer – PyTorch Accelerator
Client is seeking an experienced PyTorch maintainer to bring new AI accelerators to PyTorch and get that work accepted into the official upstream project.
Responsibilities:
  • Upstream new hardware support to PyTorch: RFCs, pull requests, code reviews, issue triage, and ongoing maintenance.
  • Work with PyTorch maintainers and working groups to align integration with PyTorch architecture, testing standards, and release requirements.
  • Design and implement backend integration (PrivateUse1, dispatch keys, operator registration, memory management, streams/events, autograd), partnering with compiler, runtime, kernel, driver, and hardware teams.
  • Improve ATen operators, torch.compile, distributed training, mixed precision, and profiling; build and maintain tests, CI workflows, and benchmarks for correctness and performance.
  • Debug correctness, performance, memory, build, and compatibility issues across the PyTorch stack; write clear documentation and mentor other engineers.
Basic Qualifications:
  • 5+ years of experience in open-source ecosystem development or related roles.
  • Strong hands-on experience with PyTorch internals: ATen, the dispatcher, operator registration, autograd, tensor/device abstractions, and Python/C++ extensions.
  • Strong C++ and Python skills, with a track record of contributing clean, well-tested code to large open-source projects (design discussions, code reviews, pull requests, CI debugging).
  • Experience integrating ML frameworks with hardware accelerators, runtimes, compilers, kernels, or device drivers, and a good understanding of GPU/AI accelerator architecture (memory hierarchy, asynchronous execution, streams/events, profiling).
  • Comfortable with PyTorch build/test workflows (Linux, CMake, GitHub, CI) and debugging across Python, C++, runtime, and hardware layers.
  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
Preferred Qualifications:
  • Recognized PyTorch contributor or maintainer, with changes accepted into the main project.
  • Experience with PyTorch accelerator integration: PrivateUse1 backend development, OpenReg-style reference implementations, or out-of-tree backend maintenance.
  • Experience with torch.compile (TorchDynamo, TorchInductor), MLIR/LLVM, Triton, or XLA, or optimizing large-scale LLM training (e.g. VeRL) and inference (e.g., vLLM, SGLang).
  • Experience building benchmarking, profiling, and performance regression systems; familiarity with distributed backends such as NCCL, Client, HCCL, oneCCL, or custom ProcessGroup implementations.
  • Experience working with hardware vendors or open-source foundations.
Why Work With Us?
We believe in more than just jobs—we build careers. At Net2Source, we champion leadership at all levels, celebrate diverse perspectives, and empower you to make an impact. Think work-life balance, professional growth, and a collaborative culture where your ideas matter.
Our Commitment to Inclusion & Equity
Net2Source is an equal opportunity employer, dedicated to fostering a workplace where diverse talents and perspectives are valued. We make all employment decisions based on merit, ensuring a culture of respect, fairness, and opportunity for all, regardless of age, gender, ethnicity, disability, or other protected characteristics.
Awards & Recognition
• America's Most Honored Businesses (Top 10%)
• Fastest-Growing Staffing Firm by Staffing Industry Analysts
• INC 5000 List for Eight Consecutive Years
• Top 100 by Dallas Business Journal
• Spirit of Alliance Award by Agile1
Ready to Level Up Your Career?
Click Apply Now and let's make it happen.

Regards,

Ayush Upadhyay
Team Lead – IT & Engineering
Cell: (503) 530-4595 x 558 / (872) 217-2038  
Email: upadhyay.ayush@net2source.com
LinkedIn: linkedin.com/in/ayush-upadhyay-159b95203
Net2Source Inc.
Global HQ Address – 270 Davidson Ave, Suite 704, Somerset, NJ 08873, USA
Office: (201) 340-8700

Senior Staff Engineer – PyTorch Accelerator · Net2Source

Auto apply with Likeremote