Note: The job is a remote job and is open to candidates in USA. Pantheon Data is a private small business based in the Washington, DC area, specializing in various service offerings including technology and program management. They are seeking a Senior Data Engineer to design and optimize data foundations for Generative AI applications, focusing on data pipelines and AWS integration.
Responsibilities
• LLM Data Pipelines: Design and implement scalable data ingestion and transformation pipelines specifically for RAG (Retrieval-Augmented Generation) architectures
• AWS Bedrock Integration: Operationalize LLM workflows using AWS Bedrock, managing model invocations, and embedding generation
• Data Enrichment & Quality: Develop advanced Python-based processing jobs to clean and enrich unstructured data with metadata to improve LLM retrieval accuracy
• Vector Database Management: Architect and maintain vector stores (e.g., OpenSearch Serverless or Postgressql pgvector) to support efficient semantic search
• Cloud Architecture: Leverage core AWS services (S3, Glue, Lambda, Step Functions) to build resilient, automated data workflows
• DevSecOps Collaboration: Work with the security team to ensure all data handling meets stringent compliance standards (e.g., FedRAMP/DISA STIGs) through Infrastructure as Code
Skills
• Expert-level Python programming with experience in libraries such as Pandas and LLM orchestration frameworks like LangChain or LlamaIndex
• Hands-on experience with AWS Bedrock and Amazon SageMaker
• Proven track record with AWS Glue (ETL), Athena, and Redshift
• Must hold a recognized Data Science Certification (e.g., AWS Certified Data Engineer, Databricks Certified Data Scientist)
• Proficiency in both SQL and NoSQL, with specific experience in Vector Databases
• Ability to work effectively remotely in cross-functional teams
• Ability to meet deadlines and produce quality work
• Proficient in Microsoft Suite software including Outlook, Word, Excel, SharePoint, and PowerPoint
• Bachelor's Degree
• U.S. Citizenship with the ability to obtain and maintain a DoD Secret clearance
Benefits
• SmartBenefits through the Washington Metro Area Transportation Authority
• Tuition assistance may be available for continuing education expenses and certifications related to their position
Company Overview
• Pantheon Data is an IT firm that offers cyber security, system engineering, and consulting services. It was founded in 2011, and is headquartered in Leesburg, Virginia, USA, with a workforce of 501-1000 employees. Its website is https://pantheon-data.com.
Apply Now
Apply Now