- Create realistic clinical pharmacy assignments based on fully synthetic patient records, including medication reconciliation, renal and hepatic dose adjustments, therapeutic interchange, anticoagulation reviews, high-alert medication checks, pharmacist intervention notes, and prescriber queries.
- Develop realistic hospital medication-use protocols containing institution-specific policies, including formulary guidelines, therapeutic interchange requirements, dosing tables, independent double-check procedures, and clinical situations requiring pharmacist escalation.
- Design assignments that require AI models to apply specific institutional medication-use protocols rather than relying solely on standard drug references, product labeling, or general clinical guidelines.
- Prepare realistic clinical reference materials, including medication lists, medication orders, laboratory results, clinical notes, and discharge summaries.
- Produce gold-standard reference deliverables demonstrating clinical accuracy, patient-safety awareness, professional judgment, and appropriate clinical documentation.
- Develop detailed grading rubrics with clear evaluation criteria, point values, and pass/fail requirements to distinguish acceptable and unacceptable clinical deliverables.
- Ensure all assignments, patient records, protocols, and supporting materials use fully synthetic information and comply with applicable US healthcare and pharmacy regulations.
- Peer-review clinical pharmacy task packages created by other subject-matter experts, including assignment instructions, synthetic patient records, medication-use protocols, reference deliverables, and grading rubrics.
- Verify the internal consistency and clinical plausibility of patient records, including medication doses, administration schedules, laboratory results, diagnoses, and clinical notes.
- Assess whether institutional protocols are realistic, internally consistent, and sufficiently specific to require correct application by AI models.
- Evaluate whether grading rubrics appropriately prioritize patient safety, medication-related risks, protocol compliance, and the need to escalate clinical concerns.
- Review assignments for compliance with applicable US federal, state, and local regulations, including FDA labeling requirements, DEA controlled-substance rules, state pharmacy practice acts, and Joint Commission medication management standards.
- Identify duplicate or substantially similar assignments within the existing benchmark pool.
- Provide clear Reject, Revise, or Approve recommendations for peer-reviewed assignments, supported by concise clinical rationale.
- Independently evaluate completed AI-generated deliverables against assignments developed by other subject-matter experts.
- Compare two candidate deliverables and determine whether one is Better, About as Good As (a tie), or Worse than the other.
- Assess deliverables based on clinical accuracy, completeness, instruction-following, medication safety, protocol adherence, and professional documentation quality.
- Apply independent clinical judgment rather than relying exclusively on point-based scoring systems or checklists.
- Identify medication-related risks, incorrect dosing, drug interactions, clinical inconsistencies, and failures to escalate concerns appropriately.
- Provide concise, evidence-based explanations supporting evaluation decisions and highlighting important clinical differences between candidate deliverables.
- Maintain professional independence and objectivity throughout task authoring, peer review, and grading activities.
- Meet project deadlines while maintaining consistent clinical quality and accuracy throughout the engagement.
- At least 5 years of professional clinical pharmacy experience, including hospital or inpatient pharmacy practice.
- PharmD degree or Bachelor of Science in Pharmacy with equivalent clinical experience.
- Active, unrestricted pharmacist license in a US state.
- Hands-on experience with clinical pharmacy responsibilities, including medication reconciliation, medication order verification, dose adjustments, and medication safety reviews.
- Demonstrated experience developing, writing, reviewing, or maintaining medication-use policies, clinical protocols, or formulary guidance.
- Experience contributing to Pharmacy and Therapeutics (P&T) Committee activities or similar medication-policy development processes.
- Strong understanding of how institution-specific medication-use policies differ from standard drug references, product labeling, and general clinical guidelines.
- Working knowledge of applicable US federal, state, and local healthcare regulations, including FDA labeling requirements, DEA controlled-substance rules, state pharmacy practice acts, and Joint Commission medication management standards.
- Strong clinical judgment and the ability to independently assess complex medication-related scenarios.
- Excellent analytical, critical-thinking, and problem-solving skills, particularly when identifying medication-related risks, clinical inconsistencies, and patient-safety concerns.
- Demonstrated ability to evaluate clinical documentation objectively and provide clear, concise, evidence-based recommendations.
- Strong written English communication skills and the ability to prepare detailed clinical assignments, protocols, evaluation criteria, and professional documentation.
- Ability to work independently, follow detailed instructions, maintain professional standards, and meet agreed project deadlines.
- Availability of at least 20 hours per week on a sustained basis throughout the engagement.
Preferred Qualifications
- Board certification in a relevant pharmacy specialty, such as Board Certified Pharmacotherapy Specialist (BCPS).
- Previous experience serving on a Pharmacy and Therapeutics Committee or medication-safety committee.
- Experience developing, reviewing, or maintaining hospital medication-use policies, formulary guidelines, and clinical decision-support protocols.
- Experience with clinical pharmacy task development, professional assessment design, peer review, or quality assurance.
- Familiarity with AI evaluation, AI training data, prompt creation, annotation, or other AI-related projects.
- Experience evaluating complex clinical deliverables against established protocols, institutional policies, and professional standards.
- Strong understanding of medication safety procedures, high-alert medications, therapeutic interchange, and clinical escalation requirements.