Business Analyst: Non-US Raters

This role is for one of our clients We are seeking detail-oriented and analytical Business Analysts – Non-US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, applying predefined evaluation criteria, conducting structured assessments, and delivering accurate, well-documented judgments. Candidates should have strong analytical skills, business analysis experience, attention to detail, and the ability to work independently in a remote, fast-paced environment. This opportunity is suitable for professionals interested in contributing to AI evaluation and improving the quality, relevance, and reliability of AI-generated responses. Job Details • Role: Business Analyst – Non-US Raters • Experience: 3+ years • Employment Type: Short-term contract • Contract Duration: 16 weeks • Location: Argentina, Peru, Mexico, Brazil, Chile, Colombia, India, and Pakistan • Compensation: USD 15 per hour • Start Date: Immediate • Work Mode: Fully remote • Availability: Full-time commitment of 8 hours per day • Time Zone Requirement: Minimum 4 hours of overlap with the US Pacific Time (PST) time zone • Work Schedule: Five working days per week, including weekends when required, with two weekdays off Requirements Key Responsibilities • Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria. • Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses. • Analyze business requirements and translate them into clear evaluation guidelines and functional specifications. • Gather, interpret, and document relevant information to support consistent and objective assessments. • Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement. • Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy. • Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions. • Track task progress, quality metrics, and project deliverables while meeting established deadlines. • Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework. • Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process. Required Qualifications and Skills • Bachelor's degree in Business Administration, Finance, Computer Science, or a related field. • At least 3 years of experience as a Business Analyst or in a similar analytical role. • Strong analytical thinking, problem-solving, and decision-making abilities. • Excellent written communication skills and the ability to explain findings clearly. • Strong attention to detail and the ability to assess information objectively. • Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools. • Experience with requirement gathering, process mapping, and business documentation. • Ability to work independently, manage multiple priorities, and meet strict deadlines. • Strong documentation skills and the ability to follow structured evaluation guidelines. • Familiarity with Agile or Scrum methodologies is an advantage. • Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap. Engagement Benefits • Opportunity to contribute to projects focused on AI evaluation and response quality. • Fully remote work arrangement with the flexibility of working from your location. • Exposure to structured AI assessment workflows and quality evaluation processes. • Opportunity to contribute to projects with international reach. • Clearly defined contract duration, hourly compensation, and evaluation responsibilities. Important Engagement Details • This is a project-based contract lasting 16 weeks. • Work will consist of evaluating multiple chatbot responses and submitting a final assessment for each assigned task. • Candidates must be available for 8 hours per day, five days per week, with four hours of overlap with US Pacific Time. • The schedule may include weekend work, with two weekdays off each week. • Candidates are expected to maintain consistent evaluation quality, follow project guidelines, and complete assigned tasks within the required timelines.