AI Data Analyst – Agentic AI

AI Data Analyst – Agentic AI

Location: Charlotte, NC – Onsite

Job Summary

We are seeking an experiencedAI Data Analyst to analyze data, generate insights, and support the development and evaluation ofAI/ML and Generative AI solutions. This role bridges traditional data analysis with emerging AI capabilities, helping teams make data-driven decisions and assess the performance and impact of AI systems.

Key Responsibilities

• Analyze structured and unstructured data to identify trends, patterns, and actionable insights.
• Support evaluation of AI/ML and Generative AI model outputs, including accuracy, quality, bias, and relevance.
• Design and build dashboards and reports to track AI system performance and business KPIs.
• Partner with Data Scientists and AI Engineers to define metrics for model evaluation and monitoring.
• Write and optimize SQL queries to extract and transform data from various sources.
• Perform Exploratory Data Analysis (EDA) to support model development and feature identification.
• Assist in labeling, curating, and validating datasets used for training and fine-tuning AI models.
• Translate business requirements into analytical frameworks and present findings to stakeholders.
• Identify data quality issues and work with engineering teams to resolve them.
• Stay current on AI/ML trends relevant to data analysis and reporting.

Required Qualifications

• 5+ years of experience inData Analysis, Business Intelligence, or related analytics roles.
• Strong proficiency inSQL and data querying/transformation.
• Experience withPython (Pandas, NumPy) or R for data analysis.
• Experience with BI/visualization tools such asTableau, Power BI, Looker, or similar.
• Understanding ofAI/ML concepts and exposure to evaluating model outputs or working alongside ML teams.
• Strong statistical analysis skills.
• Excellent communication skills with the ability to translate data insights for technical and non-technical stakeholders.
• Experience working with large datasets in cloud data warehouses such asBigQuery, Snowflake, or Redshift.

Preferred Qualifications

• Experience evaluatingGenerative AI/LLM outputs, including:
  • Prompt quality
  • Hallucination detection
  • Response scoring
• Familiarity withGCP data tools, including BigQuery, Looker, and Vertex AI.
• Experience withA/B testing and experimentation frameworks.
• Background indata governance or data quality frameworks.
• Exposure to Python-based ML libraries such asscikit-learn.

Good to Have

• GCP
• Vertex AI
• Data Modeling
• ETL/ELT
• Data Quality
• Data Visualization
• Prompt Engineering
• RAG
• Cloud Storage
• Dataflow

Core Technical Skills

SQL | Python | Data Analysis | AI/ML | Generative AI | LLM Evaluation | Statistical Analysis | BigQuery | Snowflake | Redshift | Tableau | Power BI | Looker | GCP | Vertex AI | Data Modeling | ETL/ELT | Data Quality | Prompt Engineering | RAG