NCDHHS – Senior Generative AI Developer

IT
November 20, 2026
$90 - $110 / hour

Job Overview

  • Date Posted
    November 20, 2026
  • Offered Salary
    $90 - $110 / hour
  • Expiration date
    November 25, 2026
  • Job Status
    Open
  • Requisition ID
    814296
  • Working Type
    Hybrid
  • Duration
    12 Months and 4 Days
  • Interview Type
    Both Phone and In Person
  • Work Address
    1915 Health Services Way, Raleigh, NC 27607

Job Description

NC DHHS requires the services of a Senior Generative
AI Developer who is responsible for designing, developing, and deploying
production-grade Artificial Intelligence solutions leveraging Large Language
Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques,
and secure enterprise data systems. The role requires strong technical skills
in Python, cloud-native development, data engineering, and the integration of
structured and unstructured databases into AI systems. The developer ensures
all AI solutions adhere to organizational standards for security, privacy,
compliance, and Responsible AI principles. This position collaborates with
engineering, security, data, product, and governance teams to advance scalable,
ethical, and secure AI adoption across the organization. The key responsibilities for this position will include the following:

·      
Build and deploy LLM-driven features, prompts,
and agent workflows.

·      
Customize models using fine-tuning and adapter
techniques.

·      
Develop RAG pipelines using vector, SQL, and
NoSQL databases.

·      
Manage secure ingestion of enterprise content
with proper metadata and PII protection.

·      
Use relational, NoSQL, and vector databases to
support AI workloads.

·      
Apply performance tuning, access control,
encryption, and compliant data handling.

·      
Implement AI safety controls and secure model
access.

·      
Ensure Responsible AI practices include bias,
fairness, and privacy reviews.

·      
Build secure, scalable microservices to
integrate AI features into applications.

·      
Implement best practices for reliability, error
handling, and observability.

·      
Maintain CI/CD pipelines for models and AI
services.

·      
 Monitor
performance, cost, and drift.

Support
documentation and audit readiness.

Responsibilities and required skills

Hands-on experience in applied machine learning or Generative AI development. (3 Years)
Experience working with a major cloud platform (Azure, AWS, or GCP). (3 Years)
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph). (3 Years)
Experience building RAG pipelines or LLM-driven applications. (2 Years)
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization. (2 Years)
SQL experience including data modeling, transformations, and performance tuning (5 Years)
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB). (2 Years)
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management. (2 Years)
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards. (2 Years)
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions. (5 Years)
Experience with Agile (Scrum, Kanban, or SAFe) development. (3 Years)
Ability to organize, prioritize, and follow complex and/or detailed technical procedures. (3 Years)
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace. (2 Years)
Familiarity with Promptflow, Ragas, or similar automated evaluation tools. (2 Years)
Experience designing supervised finetuning workflows or LoRA-based training pipelines. (2 Years)
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms. (2 Years)
Certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework. (2 Years)

Related Jobs