General AI Evaluation

Management Specialist

ContractorRemote20 openings$20 - $45/hour

About this role

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Skills

Business AnalysisInformation SynthesisWritten And Verbal CommunicationAttention To DetailIndependent Work

Key responsibilities

  • Analyze authentic workplace communications, including Slack conversations, email threads, and internal files, to extract actionable insights and context.
  • Identify and trace key decisions, action items, dependencies, and unresolved issues within fragmented business information.
  • Synthesize diverse sources of knowledge into complex, realistic tasks that reflect real-world business scenarios for evaluating AI agents.
  • Create clear, detailed prompts and evaluation rubrics based on provided business materials.
  • Distinguish between relevant and irrelevant information across evolving business contexts and workflows.
  • Handle ambiguity and incomplete information with structured, methodical approaches.
  • Maintain strict confidentiality while managing authentic workplace data and sensitive business materials.

Required skills & qualifications

  • Expertise in workplace domains such as management, operations, marketing, sales, engineering, or general startup/business operations.
  • Superior written and verbal communication skills, with an ability to interpret and clarify complex workplace exchanges.
  • Demonstrated ability to connect information across multiple sources and timelines.
  • Experience working with unstructured or messy business data and extracting actionable knowledge.
  • Strong judgment in resolving ambiguities and distinguishing information relevance.
  • Proven ability to work independently in remote environments while collaborating effectively with a distributed team.
  • High attention to detail and strong organizational skills.
Apply on micro1 →

This role is posted on our partner platform. When you click Apply, you'll go to the posting, where the application, interview, skill validation, and onboarding all happen. lehico is an independent site that surfaces these opportunities — we don't process applications or guarantee acceptance.