Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
4

LLM Engineer (Data Generation)

42dot
๐Ÿ‡ฐ๐Ÿ‡ท South Korea
Hybrid
3 weeks ago
  • AI
  • Machine Learning
  • Python
  • RLHF
  • OpenAI
  • Airflow
  • Ray
  • Natural Language Processing
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

About the Team & Mission

LLM Engineer (Data Generation)๋Š” Data-Centric AI ๊ด€์ ์—์„œ ๋ชจ๋ธ ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ํ•„์š”ํ•œ ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ์„ค๊ณ„ยท์ƒ์„ฑยทํ‰๊ฐ€ยท๊ฐœ์„ ํ•˜๋Š” ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

๋ชจ๋ธ์˜ ์„ฑ๋Šฅ ๋ณ‘๋ชฉ๊ณผ Failure case๋ฅผ ๋ถ„์„ํ•˜์—ฌ ๋ฐ์ดํ„ฐ ์š”๊ตฌ์‚ฌํ•ญ์„ ์ •์˜ํ•˜๊ณ , Instruction Data, Preference Data, Reasoning Data, Domain-specific Data ๋“ฑ ๋ชฉ์ ์— ๋งž๋Š” ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ๊ตฌ์ถ•ํ•˜๋ฉฐ, Data Generation Pipeline, ํ•™์Šต ๊ฒฐ๊ณผ ๊ธฐ๋ฐ˜ Data Evaluation, Data Curation์„ ํ†ตํ•ด ๋Œ€๊ทœ๋ชจ ํ•™์Šต ๋ฐ์ดํ„ฐ์˜ ํ’ˆ์งˆ์„ ์ฒด๊ณ„์ ์œผ๋กœ ๊ฐœ์„ ํ•˜๊ณ , ์ฐจ์„ธ๋Œ€ Generative AI ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ ํ–ฅ์ƒ์— ๊ธฐ์—ฌํ•ฉ๋‹ˆ๋‹ค.

Responsibilities

  • ๋ชจ๋ธ ์„ฑ๋Šฅ ๊ฐœ์„ ์„ ์œ„ํ•œ ๋ฐ์ดํ„ฐ ์„ค๊ณ„ ๋ฐ ์ƒ์„ฑ

    • Research ๋ฐ Model Training ํŒ€๊ณผ ํ˜‘์—…ํ•˜์—ฌ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ ๋ณ‘๋ชฉ, Failure Case, ํ•™์Šต ๋ชฉํ‘œ๋ฅผ ๋ถ„์„ํ•˜๊ณ  ๋ฐ์ดํ„ฐ ์š”๊ตฌ์‚ฌํ•ญ์„ ์ •์˜ํ•ฉ๋‹ˆ๋‹ค.

    • Instruction Data, Preference Data, Reasoning Data, Domain-specific Data ๋“ฑ ๋ชฉ์ ์— ๋งž๋Š” ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ์„ค๊ณ„ยท์ƒ์„ฑยท์ •์ œํ•ฉ๋‹ˆ๋‹ค.

    • ์ƒ์„ฑ๋œ ๋ฐ์ดํ„ฐ๊ฐ€ ๋ชจ๋ธ ์„ฑ๋Šฅ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์„ ์‹คํ—˜์ ์œผ๋กœ ๋ถ„์„ํ•˜๊ณ , ๊ฒฐ๊ณผ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ ์ „๋žต์„ ๋ฐ˜๋ณต์ ์œผ๋กœ ๊ฐœ์„ ํ•ฉ๋‹ˆ๋‹ค.

  • Data Generation Pipeline ๊ตฌ์ถ•

    • Synthetic Data๋ฅผ ํฌํ•จํ•œ ํ•™์Šต ๋ฐ์ดํ„ฐ ์ƒ์„ฑ ์ž๋™ํ™” ํŒŒ์ดํ”„๋ผ์ธ์„ ์„ค๊ณ„ํ•˜๊ณ  ์šด์˜ํ•ฉ๋‹ˆ๋‹ค.

    • ๋Œ€๊ทœ๋ชจ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ Workflow๋ฅผ ๊ตฌ์ถ•ํ•˜์—ฌ ์•ˆ์ •์ ์ด๊ณ  ํšจ์œจ์ ์ธ ๋ฐ์ดํ„ฐ ์ƒ์‚ฐ ํ™˜๊ฒฝ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

    • ์ƒ์„ฑ ๋น„์šฉ, ์ฒ˜๋ฆฌ ์†๋„ ๋ฐ ํ’ˆ์งˆ์„ ๊ณ ๋ คํ•œ Pipeline์„ ์ง€์†์ ์œผ๋กœ ์ตœ์ ํ™”ํ•ฉ๋‹ˆ๋‹ค.

  • Data Quality ๋ฐ Evaluation

    • ๋ฐ์ดํ„ฐ์˜ ํ’ˆ์งˆ๊ณผ ํ•™์Šต ํšจ๊ณผ๋ฅผ ์ •๋Ÿ‰์ ยท์ •์„ฑ์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜๋Š” ๊ธฐ์ค€์„ ์ •์˜ํ•ฉ๋‹ˆ๋‹ค.

    • LLM-as-a-Judge, Rule-based Validation, Human Feedback ๋“ฑ์„ ํ™œ์šฉํ•˜์—ฌ ๋ฐ์ดํ„ฐ ํ’ˆ์งˆ์„ ๊ฒ€์ฆํ•ฉ๋‹ˆ๋‹ค.

    • ๋ฐ์ดํ„ฐ ํ’ˆ์งˆ ๊ฐœ์„ ์„ ์œ„ํ•œ Iterative Generation ๋ฐ Filtering ์ „๋žต์„ ๊ฐœ๋ฐœํ•ฉ๋‹ˆ๋‹ค.

Qualifications

  • LLM, Machine Learning ๋˜๋Š” Data Generation ๊ด€๋ จ ์—…๋ฌด ๊ฒฝ๋ ฅ 3๋…„ ์ด์ƒ

  • ๋”ฅ๋Ÿฌ๋‹, ๋จธ์‹ ๋Ÿฌ๋‹ ๋ฐ ์ž์—ฐ์–ด์ฒ˜๋ฆฌ์— ๋Œ€ํ•œ ์ „๋ฐ˜์ ์ธ ์ดํ•ด

  • ๋ชจ๋ธ ํ•™์Šต ๋ฐ์ดํ„ฐ์˜ ๊ตฌ์„ฑ, ์ „์ฒ˜๋ฆฌ, ํ’ˆ์งˆ ํ‰๊ฐ€ ๋ฐ ํ•™์Šต ๋ฐ˜์˜ ๊ณผ์ •์— ๋Œ€ํ•œ ์ดํ•ด

  • Python ๊ธฐ๋ฐ˜ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ ๋ฐ ์ž๋™ํ™” ๊ฐœ๋ฐœ ์—ญ๋Ÿ‰

  • ๋Œ€๊ทœ๋ชจ ํ•™์Šต ๋ฐ์ดํ„ฐ์…‹์˜ ์ฒ˜๋ฆฌ, ์ •์ œ, ํ•„ํ„ฐ๋ง ๋ฐ ํ’ˆ์งˆ ๊ด€๋ฆฌ ๊ฒฝํ—˜ ๋˜๋Š” ์ด์— ์ค€ํ•˜๋Š” ์—ญ๋Ÿ‰

  • LLM์„ ํ™œ์šฉํ•œ Synthetic Data ์ƒ์„ฑ, Data Evaluation ๋˜๋Š” Data Curation ๊ฒฝํ—˜

  • LLM API ๋ฐ Prompting/Generation Strategy์— ๋Œ€ํ•œ ์ดํ•ด ๋˜๋Š” ํ™œ์šฉ ๊ฒฝํ—˜

  • ๋›ฐ์–ด๋‚œ ๋ฌธ์ œ ํ•ด๊ฒฐ ๋Šฅ๋ ฅ๊ณผ ํ˜‘์—… ๋ฐ ์ปค๋ฎค๋‹ˆ์ผ€์ด์…˜ ์—ญ๋Ÿ‰

Preferred Qualifications

  • LLM Pre-training, Supervised Fine-tuning(SFT), Preference Optimization(DPO/RLHF/RLAIF) ๋“ฑ LLM ๋Œ€๊ทœ๋ชจ ํ•™์Šต ๋ฐ์ดํ„ฐ ๊ตฌ์ถ• ๊ฒฝํ—˜

  • LLM Evaluation Framework(OpenAI Evals, LM Evaluation Harness, DeepEval ๋“ฑ) ๋˜๋Š” ์ž์ฒด ํ‰๊ฐ€ ์‹œ์Šคํ…œ ๊ตฌ์ถ• ๊ฒฝํ—˜

  • ๋ฉ€ํ‹ฐํ„ด ๋Œ€ํ™”, Tool Calling, Agent, Reasoning, Code Generation ๋“ฑ ๊ณ ๋‚œ๋„ LLM ๋ฐ์ดํ„ฐ ์„ค๊ณ„ ๊ฒฝํ—˜

  • Python ๊ธฐ๋ฐ˜ ๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ(Airflow, Ray, Spark ๋“ฑ) ๋˜๋Š” ๋Œ€๊ทœ๋ชจ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ ํ™˜๊ฒฝ ๊ตฌ์ถ• ๊ฒฝํ—˜

  • Generative AI, LLM, NLP ๊ด€๋ จ ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ ๊ธฐ์—ฌ ๋˜๋Š” ๋…ผ๋ฌธยท๊ธฐ์ˆ  ๋ฐœํ‘œ ๊ฒฝํ—˜

Interview Process

  • ์„œ๋ฅ˜ ์ „ํ˜•

  • ์ฝ”๋”ฉยท๊ณผ์ œ ํ…Œ์ŠคํŠธ

  • 1์ฐจ ๋ฉด์ ‘ (ํ™”์ƒ, 1์‹œ๊ฐ„ ๋‚ด์™ธ)

  • 2์ฐจ ๋ฉด์ ‘ (๋Œ€๋ฉด ํ˜น์€ ํ™”์ƒ, 3์‹œ๊ฐ„ ๋‚ด์™ธ)

  • ์ฒ˜์šฐ ํ˜‘์˜ยท์ž…์‚ฌ

Additional Information

  • ์ „ํ˜• ์ ˆ์ฐจ๋Š” ์ผ์ • ๋ฐ ์ง„ํ–‰ ์ƒํ™ฉ์— ๋”ฐ๋ผ ์ผ๋ถ€ ๋ณ€๊ฒฝ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๊ฐ ์ „ํ˜• ๊ฒฐ๊ณผ๋Š” ๋“ฑ๋กํ•˜์‹  ์ด๋ฉ”์ผ๋กœ ๊ฐœ๋ณ„ ์•ˆ๋‚ด๋“œ๋ฆฝ๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ์ œ์ถœ ์‹œ ์ฃผ๋ฏผ๋“ฑ๋ก๋ฒˆํ˜ธ, ๊ฐ€์กฑ๊ด€๊ณ„, ํ˜ผ์ธ ์—ฌ๋ถ€, ์—ฐ๋ด‰, ์‚ฌ์ง„, ์‹ ์ฒด์กฐ๊ฑด, ์ถœ์‹  ์ง€์—ญ ๋“ฑ ์ฑ„์šฉ์ ˆ์ฐจ๋ฒ•์ƒ ์š”๊ตฌ ๊ธˆ์ง€๋œ ์ •๋ณด๋Š” ์ œ์™ธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ์ ‘์ˆ˜ ์ค‘ ์˜ค๋ฅ˜๊ฐ€ ๋ฐœ์ƒํ•˜๊ฑฐ๋‚˜ ๊ธฐํƒ€ ๋ฌธ์˜ ์‚ฌํ•ญ์ด ์žˆ์„ ๊ฒฝ์šฐ, recruit@42dot.ai๋กœ ๋ฌธ์˜ํ•ด ์ฃผ์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค.

  • ๊ตญ๊ฐ€๋ณดํ›ˆ๋Œ€์ƒ์ž ๋ฐ ์ทจ์—…๋ณดํ˜ธ ๋Œ€์ƒ์ž๋Š” ๊ด€๊ณ„๋ฒ•๋ น์— ๋”ฐ๋ผ ์šฐ๋Œ€ํ•ฉ๋‹ˆ๋‹ค.

  • ์žฅ์• ์ธ ๊ณ ์šฉ ์ด‰์ง„ ๋ฐ ์ง์—…์žฌํ™œ๋ฒ•์— ๋”ฐ๋ผ ์žฅ์• ์ธ ๋“ฑ๋ก์ฆ ์†Œ์ง€์ž๋ฅผ ์šฐ๋Œ€ํ•ฉ๋‹ˆ๋‹ค.

  • 42dot์€ ์˜๋ขฐํ•˜์ง€ ์•Š์€ ์„œ์น˜ํŽŒ์˜ ์ด๋ ฅ์„œ๋ฅผ ๋ฐ›์ง€ ์•Š์œผ๋ฉฐ, ์š”์ฒญํ•˜์ง€ ์•Š์€ ์ด๋ ฅ์„œ์— ๋Œ€ํ•ด ์ˆ˜์ˆ˜๋ฃŒ๋ฅผ ์ง€๋ถˆํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

  • ์ง€์›์„œ ๋‚ด์šฉ ์ค‘ ํ—ˆ์œ„ ์‚ฌ์‹ค์ด ๋ฐœ๊ฒฌ๋  ๊ฒฝ์šฐ, ์ž…์‚ฌ๊ฐ€ ์ทจ์†Œ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • ์ธํ„ฐ๋ทฐ ํ”„๋กœ์„ธ์Šค ์ข…๋ฃŒ ํ›„ ์ง€์›์ž์˜ ๋™์˜ํ•˜์— ํ‰ํŒ์กฐํšŒ๊ฐ€ ์ง„ํ–‰๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • 3๊ฐœ์›”์˜ ์ˆ˜์Šต๊ธฐ๊ฐ„์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

ย 

LLM Engineer (Data Generation) ยท 42dot

Auto apply with Likeremote