About the Role
Our client, a prominent leader in legal publishing, is seeking multiple qualified attorneys to participate in an innovative legal content project. This is a remote, full-time role requiring 40 hours of work per week, with an initial duration of several months and the potential for extension. Compensation is set at $30 per hour. The project focuses on testing and refining the outputs of a Large Language Model (LLM) designed to generate AI-based summaries of U.S. court opinions, complaints, statutory summaries, and legal annotations. Successful candidates will play an integral role in ensuring the accuracy, clarity, and reliability of AI-generated legal content.
Job Overview
In this position, attorneys will work within an online platform to create precise inputs and prompts for the LLM, as well as analyze its generated outputs for quality and accuracy. The work involves assessing whether AI-generated summaries meet specific content requirements and verifying the correctness of statutory references, case citations, and legal interpretations. Attorneys will be responsible for providing both assessment ratings and detailed feedback to assist in improving the model’s performance. This role is well-suited for detail-oriented legal professionals who are comfortable combining traditional legal analysis with modern AI technology applications.
Key Responsibilities
Your main duties will include evaluating AI-generated legal summaries for compliance with required content elements and accuracy in legal citations. You will also be tasked with generating inputs for the LLM to test its capabilities in summarizing various types of U.S. legal documents. Using provided evaluation guidelines, you will assign ratings to outputs and offer constructive feedback where needed. This may involve flagging inaccuracies, suggesting improvements, and ensuring summaries align with legal standards. Additionally, you will need to work efficiently to meet quota-based production targets while maintaining exceptional quality in your analyses and assessments.
Required Qualifications
Applicants must hold a law degree and have between one to five years of relevant legal experience. Strong skills in legal research and analysis are essential, along with a high level of familiarity with U.S. legal documents and court opinions. Proficiency with Excel and comfort in using multiple software-based tools are required. The ideal candidate will demonstrate the ability to handle a high volume of work while meeting quality benchmarks, as well as the capability to deliver detailed and meaningful feedback on AI-generated legal content. Experience with structured evaluation or quality assurance processes is highly valued.
Commitment to Equal Opportunity
Our client is committed to fostering a diverse and inclusive work environment. They do not tolerate discrimination on the basis of race, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender identity, sexual orientation, or any other legally protected characteristic. As an Equal Opportunity Employer (EOE), they welcome applications from all qualified candidates, including veterans and individuals with disabilities. This role represents a unique opportunity to contribute to the future of legal content creation while working within an organization that values respect, fairness, and professional integrity.
