Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
42dot logo

Reinforcement Learning Engineer (Autonomous Driving)

42dot
  • ๐Ÿ‡ฐ๐Ÿ‡ท South Korea
  • Hybrid
  • 1 day ago
  • Machine Learning
  • Python
  • PyTorch
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

About the Team & Mission

42dot์˜ ์ž์œจ์ฃผํ–‰ VLA ํŒ€์€ Vision-Language-Action (VLA) ๋ชจ๋ธ์„ ํ†ตํ•ด ์ฐจ๋Ÿ‰์ด ๋ณต์žกํ•œ ๋„๋กœ ์ƒํ™ฉ์„ ์ดํ•ดํ•˜๊ณ , ํŒ๋‹จ์„ ์ฃผํ–‰ ํ–‰๋™์œผ๋กœ ์—ฐ๊ฒฐํ•˜๋„๋ก ๋งŒ๋“œ๋Š” ๊ธฐ์ˆ ์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค. ์‹ค์ œ ์ฃผํ–‰ ๋ฐ์ดํ„ฐ, ๋ชจ๋ธ ํ•™์Šต, closed-loop simulation๊ณผ ์‹ค์ฐจ ๊ฒ€์ฆ์„ ์—ฐ๊ฒฐํ•ด ๋ชจ๋ธ์˜ ์ทจ์•ฝ์ ์„ ๋ฐœ๊ฒฌํ•˜๊ณ  ์ฃผํ–‰ ์„ฑ๋Šฅ์„ ์ง€์†์ ์œผ๋กœ ๊ฐœ์„ ํ•˜๋Š” ๊ฒƒ์„ ๋ชฉํ‘œ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

์ด ํฌ์ง€์…˜์€ end-to-end driving model์˜ ์ฃผํ–‰ ์„ฑ๋Šฅ์„ ๋†’์ด๋Š” reinforcement learning ๋ฐฉ๋ฒ•์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค. Behavior cloning์œผ๋กœ ํ•™์Šตํ•œ ๋ชจ๋ธ์„ reward์™€ feedback์œผ๋กœ ๋” ๊ฐœ์„ ํ•  ์ˆ˜ ์žˆ๋Š” ๊ธฐํšŒ๋ฅผ ์ฐพ๊ณ , ์œ ๋งํ•œ ์•„์ด๋””์–ด์˜ ์„ค๊ณ„๋ถ€ํ„ฐ ๋Œ€๊ทœ๋ชจ ํ•™์Šต, ์—„๋ฐ€ํ•œ ํ‰๊ฐ€์™€ driving model ํ†ตํ•ฉ๊นŒ์ง€ ์ฃผ๋„ํ•  ๋ถ„์„ ์ฐพ์Šต๋‹ˆ๋‹ค.

Responsibilities

  • VLA policy์™€ simulator์˜ observation/action interface๋ฅผ ์„ค๊ณ„ํ•˜๊ณ  GRPO, PPO ๋“ฑ policy optimization ๊ธฐ๋ฒ•์œผ๋กœ closed-loop RL post-training์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค.

  • Vector ๋˜๋Š” occupancy ๊ธฐ๋ฐ˜ driving simulator์—์„œ ego์™€ traffic agent๊ฐ€ ํ•™์Šต ์ค‘์ธ policy ๋ฐ ๊ณผ๊ฑฐ checkpoint๋กœ ์ƒํ˜ธ์ž‘์šฉํ•˜๋Š” self-play training ๊ตฌ์กฐ๋ฅผ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค.

  • ํ•™์Šต๋œ policy์˜ candidate action๊ณผ trajectory๋ฅผ ์—ฌ๋Ÿฌ ๊ฐ€๋Šฅํ•œ future scenario์—์„œ rolloutํ•˜๊ณ , expected return๊ณผ safety constraint์— ๊ธฐ๋ฐ˜ํ•œ action selection์„ simulation ํ™˜๊ฒฝ ๊ฐœ๋ฐœ ๋‹ด๋‹น์ž์™€ ๊ณต๋™ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค.

  • Closed-loop benchmark๋กœ policy์˜ ์•ˆ์ „์„ฑ๊ณผ ์ผ๋ฐ˜ํ™”๋ฅผ ๊ฒ€์ฆํ•˜๊ณ  reward hacking ๋ฐ simulator bias๋ฅผ ๋ถ„์„ํ•ฉ๋‹ˆ๋‹ค.

Qualifications

  • Machine Learning, Reinforcement Learning ๋˜๋Š” Robotics ๊ด€๋ จ ๊ฒฝ๋ ฅ 3๋…„ ์ด์ƒ ๋˜๋Š” ์ด์— ์ค€ํ•˜๋Š” ์—ฐ๊ตฌ/๊ฐœ๋ฐœ ์—ญ๋Ÿ‰์„ ๋ณด์œ ํ•˜์‹  ๋ถ„.

  • Python๊ณผ PyTorch๋กœ policy learning ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ๊ตฌํ˜„ํ•˜๊ณ  ํ•™์Šต๊ณผ ํ‰๊ฐ€๋ฅผ ์ˆ˜ํ–‰ํ•œ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

  • Policy optimization, reward design๊ณผ credit assignment๋ฅผ ์ดํ•ดํ•˜๊ณ  RL ์‹คํ—˜์„ ์„ค๊ณ„ํ•  ์ˆ˜ ์žˆ์œผ์‹  ๋ถ„.

  • Simulation ๋˜๋Š” multi-agent ํ™˜๊ฒฝ์—์„œ policy๋ฅผ ํ•™์Šตํ•˜๊ณ  baseline ๋Œ€๋น„ ๊ฐœ์„ ์„ ๊ฒ€์ฆํ•œ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

  • ํ•ด์™ธ ์˜คํ”ผ์Šค์™€ ๊ธฐ์ˆ ์  ์ด์Šˆ๋ฅผ ๋…ผ์˜ํ•˜๊ณ  ํ˜‘์—…ํ•  ์ˆ˜ ์žˆ๋Š” ์˜์–ด ์ปค๋ฎค๋‹ˆ์ผ€์ด์…˜ ์—ญ๋Ÿ‰์„ ๋ณด์œ ํ•˜์‹  ๋ถ„.

Preferred Qualifications

  • Self-play, multi-agent RL ๋˜๋Š” policy population์„ ํ™œ์šฉํ•œ training ๊ตฌ์กฐ๋ฅผ ๊ฐœ๋ฐœํ•œ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

  • VLA ๋˜๋Š” generative policy์— GRPO, PPO ๋“ฑ RL post-training์„ ์ ์šฉํ•œ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

  • Vector ๋˜๋Š” occupancy ๊ธฐ๋ฐ˜ driving simulator์—์„œ policy๋ฅผ ํ•™์Šตํ–ˆ๊ฑฐ๋‚˜, world model ๊ธฐ๋ฐ˜ rollout planning์„ ๊ฐœ๋ฐœํ•œ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

  • ๋Œ€๊ทœ๋ชจ parallel rollout, distributed training ๋˜๋Š” sim-to-real ๊ฒ€์ฆ ๊ฒฝํ—˜์ด ์žˆ์œผ์‹  ๋ถ„.

Interview Process

  1. ์„œ๋ฅ˜ ์ „ํ˜•

  2. 1์ฐจ ๋ฉด์ ‘ (ํ™”์ƒ, 1์‹œ๊ฐ„ ๋‚ด์™ธ)

  3. 2์ฐจ ๋ฉด์ ‘ (๋Œ€๋ฉด ํ˜น์€ ํ™”์ƒ, 3์‹œ๊ฐ„ ๋‚ด์™ธ)

  4. ์ฒ˜์šฐ ํ˜‘์˜ยท์ž…์‚ฌ

Additional Information

  • ์ „ํ˜• ์ ˆ์ฐจ๋Š” ์ผ์ • ๋ฐ ์ง„ํ–‰ ์ƒํ™ฉ์— ๋”ฐ๋ผ ์ผ๋ถ€ ๋ณ€๊ฒฝ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๊ฐ ์ „ํ˜• ๊ฒฐ๊ณผ๋Š” ๋“ฑ๋กํ•˜์‹  ์ด๋ฉ”์ผ๋กœ ๊ฐœ๋ณ„ ์•ˆ๋‚ด๋“œ๋ฆฝ๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ์ œ์ถœ ์‹œ ์ฃผ๋ฏผ๋“ฑ๋ก๋ฒˆํ˜ธ, ๊ฐ€์กฑ๊ด€๊ณ„, ํ˜ผ์ธ ์—ฌ๋ถ€, ์—ฐ๋ด‰, ์‚ฌ์ง„, ์‹ ์ฒด์กฐ๊ฑด, ์ถœ์‹  ์ง€์—ญ ๋“ฑ ์ฑ„์šฉ์ ˆ์ฐจ๋ฒ•์ƒ ์š”๊ตฌ ๊ธˆ์ง€๋œ ์ •๋ณด๋Š” ์ œ์™ธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ์ ‘์ˆ˜ ์ค‘ ์˜ค๋ฅ˜๊ฐ€ ๋ฐœ์ƒํ•˜๊ฑฐ๋‚˜ ๊ธฐํƒ€ ๋ฌธ์˜ ์‚ฌํ•ญ์ด ์žˆ์„ ๊ฒฝ์šฐ, recruit@42dot.ai๋กœ ๋ฌธ์˜ํ•ด ์ฃผ์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค.

  • ๊ตญ๊ฐ€๋ณดํ›ˆ๋Œ€์ƒ์ž ๋ฐ ์ทจ์—…๋ณดํ˜ธ ๋Œ€์ƒ์ž๋Š” ๊ด€๊ณ„๋ฒ•๋ น์— ๋”ฐ๋ผ ์šฐ๋Œ€ํ•ฉ๋‹ˆ๋‹ค.

  • ์žฅ์• ์ธ ๊ณ ์šฉ ์ด‰์ง„ ๋ฐ ์ง์—…์žฌํ™œ๋ฒ•์— ๋”ฐ๋ผ ์žฅ์• ์ธ ๋“ฑ๋ก์ฆ ์†Œ์ง€์ž๋ฅผ ์šฐ๋Œ€ํ•ฉ๋‹ˆ๋‹ค.

  • 42dot์€ ์˜๋ขฐํ•˜์ง€ ์•Š์€ ์„œ์น˜ํŽŒ์˜ ์ด๋ ฅ์„œ๋ฅผ ๋ฐ›์ง€ ์•Š์œผ๋ฉฐ, ์š”์ฒญํ•˜์ง€ ์•Š์€ ์ด๋ ฅ์„œ์— ๋Œ€ํ•ด ์ˆ˜์ˆ˜๋ฃŒ๋ฅผ ์ง€๋ถˆํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ๋‚ด์šฉ ์ค‘ ํ—ˆ์œ„ ์‚ฌ์‹ค์ด ๋ฐœ๊ฒฌ๋  ๊ฒฝ์šฐ, ์ž…์‚ฌ๊ฐ€ ์ทจ์†Œ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • ์ธํ„ฐ๋ทฐ ํ”„๋กœ์„ธ์Šค ์ข…๋ฃŒ ํ›„ ์ง€์›์ž์˜ ๋™์˜ํ•˜์— ํ‰ํŒ์กฐํšŒ๊ฐ€ ์ง„ํ–‰๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • 3๊ฐœ์›”์˜ ์ˆ˜์Šต๊ธฐ๊ฐ„์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

A message to Future Teammates

42dot์˜ ์ž์œจ์ฃผํ–‰ VLA ํŒ€์€ Vision-Language-Action (VLA) ๋ชจ๋ธ์„ ํ†ตํ•ด ์ฐจ๋Ÿ‰์ด ๋ณต์žกํ•œ ๋„๋กœ ์ƒํ™ฉ์„ ์ดํ•ดํ•˜๊ณ , ํŒ๋‹จ์„ ์ฃผํ–‰ ํ–‰๋™์œผ๋กœ ์—ฐ๊ฒฐํ•˜๋„๋ก ๋งŒ๋“œ๋Š” ๊ธฐ์ˆ ์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค.

์‹ค์ œ ์ฃผํ–‰ ๋ฐ์ดํ„ฐ, ๋ชจ๋ธ ํ•™์Šต, closed-loop simulation๊ณผ ์‹ค์ฐจ ๊ฒ€์ฆ์„ ์—ฐ๊ฒฐํ•ด ๋ชจ๋ธ์˜ ์ทจ์•ฝ์ ์„ ๋ฐœ๊ฒฌํ•˜๊ณ  ์ฃผํ–‰ ์„ฑ๋Šฅ์„ ์ง€์†์ ์œผ๋กœ ๊ฐœ์„ ํ•˜๋Š” ๊ฒƒ์„ ๋ชฉํ‘œ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

์ด ํฌ์ง€์…˜์€ end-to-end driving model์˜ ์ฃผํ–‰ ์„ฑ๋Šฅ์„ ๋†’์ด๋Š” reinforcement learning ๋ฐฉ๋ฒ•์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค. Behavior cloning์œผ๋กœ ํ•™์Šตํ•œ ๋ชจ๋ธ์„ reward์™€ feedback์œผ๋กœ ๋” ๊ฐœ์„ ํ•  ์ˆ˜ ์žˆ๋Š” ๊ธฐํšŒ๋ฅผ ์ฐพ๊ณ , ์œ ๋งํ•œ ์•„์ด๋””์–ด์˜ ์„ค๊ณ„๋ถ€ํ„ฐ ๋Œ€๊ทœ๋ชจ ํ•™์Šต, ์—„๋ฐ€ํ•œ ํ‰๊ฐ€์™€ driving model ํ†ตํ•ฉ๊นŒ์ง€ ์ฃผ๋„ํ•  ๋ถ„์„ ์ฐพ์Šต๋‹ˆ๋‹ค.

Reinforcement Learning Engineer (Autonomous Driving) ยท 42dot

Auto apply with Likeremote