Agentic Data Engineer (Hybrid)
Location: Richmond, VA
Duration: 12+ Months Job Description:
Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The client is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction between agents and data. Responsibilities:
- Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources.
- Ability to train and fine tune large language models
- Design and build the data architecture, including databases, data lakes to support various data engineering tasks.
- Develop and manage Extract, Load, transform (ELT) processes to ensure data is accurately and efficiently moved from source systems to analytical platforms used in data science.
- Implement data pipelines that facilitate feedback loops, allowing human input to improve system performance in human-in-the-loop systems.
- Work with vector databases to store and retrieve embeddings efficiently.
- Collaborate with data scientists and engineers to preprocess data, train models, and integrate AI into applications.
- Optimize data storage and retrieval with high performance
- Statistical analysis, trends, patterns to create data formats from multiple sources.
- Strong Data engineering fundamentals
- Utilize Big data frameworks like Spark/Databricks
- Training LLMs with structed and unstructured data sets.
- Understanding of Graph DB
- Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks
- Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search
- Determine effective data partitioning criteria
- Utilize data storage system spark to implement partition schemes
- Understanding core machine learning concepts and algorithms
- Familiarity with Cloud computing skills
- Strong programming skills in Python and experience with AI/ML frameworks.
- Proficiency in vector databases and embedding models for retrieval tasks.
- Expertise in integrating with AI agent frameworks.
- Experience with cloud AI services (Azure AI).
- Experience with GIS spatial data to create markers on maps ( lat long nearest topology of road, geo-locate between datasets, correlation etc.).
- Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze data models, connect & correlate information to validate hypotheses, forecast, predict and recommend potential strategies and conduct What-if analysis.
- Bachelor's or master's degree in computer science, AI, Data Science, or a related field.
| Skill | Required / Desired | Amount | of Experience |
| Understanding the Big data Technologies | Required | 1 | Years |
| Experience developing ETL and ELT pipelines | Required | 1 | Years |
| Experience with Spark, GraphDB, Azure Databricks | Required | 1 | Years |
| Expertise in Data Partitioning | Required | 1 | Years |
| Experience with Data conflation | Required | 3 | Years |
| Experience developing Python Scripts | Required | 3 | Years |
| Experience training LLMs with structured and unstructured data sets | Required | 2 | Years |
| Experience with GIS spatial data | Required | 3 | Years |
Recommended Jobs
Radiologic Technologist
Job Description Job Description Flexible Shifts (days/hours) Available! Full-time, part-time and per diem. Sign-on Bonus of $10,000 TridentCare, the nation’s leading diagnostics imaging s…
Mobile Notary Closer
JOB TYPE: Full-time RESPONSIBILITIES: - Maintain on-going communication with existing customers to determine needs, solicit feedback, promote services. - Attend weekly sales meetings to promote…
Certified Nurse Midwife in Leesburg, VA
Are you an experienced certified nurse midwife (CNM) looking for an opportunity to provide excellent patient care? Look no further! TeamHealth is seeking a CNM to join our hospitalist team at Inova L…
DevOps Automation Engineer
Job Description Job Description Staff Level DevOps Automation Engineer Must be willing to work at least 5 days per month onsite in Arlington, Va. At this time we are unable to sponsor visa'…
Sr. Software Engineer
At The Media Trust, we're on a mission to create a safer, healthier digital world for everyone. For over 15 years, we've been the industry pioneer, working with the world's largest digital publishers…
DevOps Engineer
Description The GEOAxIS system provides Identity, Credential and Access Management for all web applications. GEOAxIS enables online, on-demand, access to NGA GEOINT content based on user's…
Data Analyst
Location: Richmond, VA Position Type: Hybrid Hybrid/Onsite Schedule: 1-2 days onsite Contract Length: 3 months Position Overview: We are seeking a detail-oriented Data Analyst with st…
Outside Sales Representative
Job Description Job Description Company Description “It's simple. Hanzo is a GREAT company to work for.” Job Description Imagine a Sales Career So Rewarding, It Could Change Your Life.…
Expert Cyber Systems Engineer
Responsibilities We are seeking an Expert Cyber Security Engineer to lead the integration of robust security practices into the design and development of complex information systems. This role …
Primary Supply Teacher- Norfolk
Are you a qualified Primary teacher with QTS? Are you looking to work on a supply basis in local schools across King’s Lynn and the surrounding areas. We are currently recruiting Primary teachers to …