Mid-level and Senior AI/ML Engineer

Experience: 5-8 YOE

Location: Fully Remote but must be located in CONUS

Company Overview:

At JR Software Solutions, we are a leading consulting firm specializing in Cloud Data and AI/ML solutions, proudly serving government and Fortune 500 clients. Our expertise in transforming IT infrastructure, driving innovation with AI and machine learning, and turning data into actionable insights sets us apart in the industry. We are seeking a highly skilled Senior Computer Systems Analyst to join our talented team and contribute to the success of our projects.

Job Description:

The AI/ML Core Activity Team is seeking a Senior AI/ML Engineer to support the strategy and enterprise coordination for AI/ML initiatives. This role involves developing and deploying advanced AI/ML models and applications, collaborating with data engineers and analysts, and contributing to the organization's AI/ML strategic goals. The ideal candidate will have significant experience in building AI/ML models and applications using modern tools such as Databricks, Azure ML, and Palantir, and will be able to support the integration of Large Language Models (LLMs) and innovative evaluation techniques.

Key Responsibilities:

• Design, develop, and deploy machine learning models using platforms such as Databricks, Azure ML, or Palantir.
• Integrate and evaluate AI/ML applications leveraging LLMs, including developing applications that utilize RAG Chat Bots and LLMs-as-a-Judge for automated evaluation.
• Prepare and manage evaluation datasets and execute predictive analysis using advanced evaluation methods and tools.
• Collaborate with cross-functional teams, including data engineers and analysts, to create innovative AI solutions that drive business value.
• Develop and maintain data engineering pipelines to support AI/ML initiatives.
• Implement CI/CD processes for AI/ML models to ensure streamlined deployments and model updates.
• Work within Agile methodologies, utilizing tools such as JIRA for project tracking and management.

Qualifications:

• 5+ years of experience designing, developing, and deploying machine learning models using Databricks, Azure ML, or Palantir.
• 3+ years of experience developing AI/ML applications integrating LLM into Databricks or Palantir.
• Experience evaluating RAG Chat Bots using LLMs-as-a-Judge, leveraging models (e.g., llama2-70B judges llama2-7B, or GPT4 judges llama2-70B) to assess generative model predictions.
• Experience with CI/CD processes for deploying AI/ML models.
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.
• Bachelor's degree in Computer Science, Software Engineering, or a related field.

Additional Skills (Preferred):

• Experience preparing evaluation datasets and retrieving chatbot models.
• Familiarity with Vector Databases.
• Strong background in developing data engineering pipelines.
• Experience working with Agile methodologies and tools such as JIRA.
• Knowledge of federal government Cloud or IT systems, familiar with CIS NIST standards, and adept at managing government-specific IT environments.
• Well-versed in healthcare IT systems, with a focus on compliance with HIPAA regulations and a background in healthcare systems technology.

Company Benefits:

• 401k Plan: Enjoy a competitive 401k plan with a substantial 4% match to assist in securing your financial future.
• Paid Time Off (PTO): Receive 2 weeks of paid time off, fostering a healthy work-life balance and providing opportunities for relaxation and rejuvenation.
• Healthcare Coverage: Access comprehensive medical, dental, and vision insurance benefits to prioritize and maintain your health and well-being.
• Employee Investment: We are committed to investing in our employees' success by offering a range of benefits aimed at supporting professional growth and personal needs