VI
Vector DB Engineer
VARITE INDIA PRIVATE LIMITED
🇮🇳 India
On-site
11 months ago
- IoT
- AI
- Pinecone
- OpenSearch
- Chroma
- Disaster Recovery
- Milvus
- pgvector
- Elasticsearch
- Neo4j
- Large Language Models
- OpenAI
- Gemini
- LangChain
- Python
11 months ago
About The Client:
An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.
About The Job:
- As a Gen AI Vector DB Engineer, you will be responsible for designing, implementing, and optimizing vectorized databases to support the organization's data processing needs.
- You will work closely with cross-functional teams to ensure efficient data storage, retrieval, and manipulation.
- The ideal candidate is a seasoned database professional with a strong background in vectorized data processing and a passion for optimizing database performance.
- Database Designing & Implementation - Design and implement vectorized databases to efficiently store vector embeddings generated by LLMs using vector data bases like Pinecone, OpenSearch or Chroma etc. Ensure seamless integration with applications and analytics platforms.
- Performance Optimization - Assessments of database performance and recommend improvements. Indexing techniques like KD-Trees, Hierarchical Navigable Small World graphs (HNSW), or Inverted Multi-Index (IMI).
- Fault tolerance using Sharding and Replication.
- Data MoClienting - Work on schema design, indexing, and partitioning strategies to enhance data organization using vector embeddings generated by LLM.
- Scalability & Reliability - Architect scalable database solutions that can handle growing data volumes and user loads. Implement strategies for data backup, recovery, and disaster recovery.
- Security & Compliance - Implement and enforce data security measures to protect sensitive information. Ensure compliance with relevant data regulations and industry standards.
- EXP- 9-14 Years
Skills & Tools:
- Experience with vector database technologies like Pinecone, Milvus, pgvector and OpenSearch or Elasticsearch etc and experience with graph database (like Neo4j) and knowledge graphs.
- Familiarity with LLM (Large Language Models), both online (OpenAI, Gemini) and offline (Llama2/3, Mistral etc.) concepts related to vector database.
- Knowledge of algorithms for creation of vector index like Random Projection, Product Quantization & Locality-Sensitive Hashing
- Knowledge of various similarity measures (Cosine, Euclidian & dot product) for embeddings & how that impacts performance.
- Strong proficiency in embeddings, vector stores, database optimization, performance tuning, and query languages
- Experience with LLM and related frameworks like Langchain and Haystack
- Programming skills in languages such as Python and any other relevant query languages.
- Excellent problem-solving skills with effective communication & collaboration abilities
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Vector DB Engineer · VARITE INDIA PRIVATE LIMITED