Senior Software Engineer

About the role

Join our small and nimble engineering team! We’re looking for an experienced engineer who enjoys working on a variety of different projects and large(ish) data pipelines (100M+ data points collected every month).

• Work in our downtown San Francisco office a few times per week

• Provide mentorship to your teammates via code and architecture review

• Help to improve, maintain and expand our end to end data pipeline

  • Create and manage data collection/crawling scripts that utilize everything from basic HTTP requests to browser and mobile app automation  (deep experience in this area is a huge plus)

  • Build and maintain automation/scheduling tooling to ensure data is collected on a timely and consistent basis (we’re currently using self hosted Dagster for scheduling)

  • Create data cleaning and normalization scripts (with some opportunity to integrate ML/LLMs for labeling/cleaning)

  • Help with miscellaneous DevOps tasks to help manage the infrastructure running all the above

• Our codebase is mostly Python with Typescript and Golang used when they make sense. We almost entirely rely on self hosted open source/core services on bare VMs via docker compose.

About you

• Proficient (intermediate or higher) in:

  • Python (e.g. can write a decorator, understand async/await, MRO, contextmanagers)

  • SQL (e.g. familiar with complex joins, efficiently bulk update 10k+ rows, schema migrations)

• Basic understanding of Linux and Docker

• Excited to work on a variety of different projects, sometimes many at the same time

• Able to execute with minimal supervision

• Bonus skills: Web Crawling, Kubernetes, LLM Pipelines, DB Administration, HomeLab/Server Administration, Background in Statistics, Full Stack Web Development, Mobile App Development

Benefits

• Lunch provided when in office

• Unlimited PTO

• 401k

• Company paid Platinum PPO health and comparable dental & vision insurance

• $160K - $220K salary, 0.5% - 3% equity

About the interview

1. 15 minute call with CTO about the position, your experience, and career goals

2. 1st 30 minute technical screening call (coding interview)

3. 2nd 30 minute technical screening call (coding interview)

4. Onsite at our office to further review your skills, learn more about us, and to get a feel for how we’d work together

5. Offer extended