About this role
This job is with our partner Micro1. Tasks Scope of Work - Design realistic, process-driven evaluation tasks that require sophisticated multi-tool coordination (e.g., calendar reconciliation, travel and expense workflows, records management, professional correspondence). - Create and assemble authentic data artifacts, including emails, calendar entries, receipts, meeting notes, and contact records, to support each evaluation scenario. - Define correct solutions and map out the step-by-step decisions an expert would take to achieve the best outcome in each scenario. - Develop comprehensive rubrics (35+ criteria) that assess both process adherence and nuanced judgment calls for AI agent outputs. - Document workflow processes and suggest improvements that reflect current best practices in the administrative domain. - Collaborate with project leads to calibrate task complexity and ensure alignment with real-world challenges faced by experienced professionals. Requirements Preferred Qualifications - 5+ years of experience supporting teams or departments within mid-to-large organizations in a professional administrative capacity. - Demonstrated process ownership and responsibility for ongoing, recurring workflows beyond ad-hoc assignments. - Expertise in documenting, evaluating, and improving inherited administrative procedures. - Proficient written and verbal communication skills with a strong command of professional correspondence standards. - Exceptional attention to detail, ensuring accuracy in both content creation and process documentation. - Comfort working with a variety of digital tools, platforms, and data formats (CSVs, PDFs, spreadsheets, technical documents).