Este perfil está escrito en inglés
Portuguese Audio Transcription & Quality Reviewer
Demonstrated experience with AI benchmark validation.
Demonstrated experience with Rubric auditing.
Demonstrated experience with AI response comparison and scoring.
Demonstrated experience with Failure analysis.
Demonstrated experience with Evidence-based findings.
Portuguese Audio Transcription & Quality Reviewer open to new opportunities
Transcribe and review Brazilian Portuguese audio, correcting omissions, incorrect words, spelling, punctuation, and linguistic inconsistencies.. Validate word-level accuracy, timestamps, speaker identification, and audio-text alignment.. Annotate overlapping speech, background noise, filled pauses, non-verbal sounds, and inaudible segments; flag ambiguous audio.. Apply detailed transcription and labeling standards consistently across high volumes of speech data.
Create realistic user requests for AI assistants using simulated personas, calendars, emails, documents, and messages.. Compare AI-generated responses and assess accuracy, usefulness, tone, and writing quality.
Review AI benchmark tasks and evaluation evidence, assess solution correctness and scoring consistency, and document actionable findings.
Review benchmark instructions, source materials, reference solutions, and rubrics for consistency, completeness, and assumptions.. Inspect agent traces, tool calls, and outputs to determine whether reported outcomes are supported by evidence.. Flag brittle grading, unfair penalties, and task, grader, tool, or environment issues; recommend improvements.
Use repositories, branches, commits, pull requests, and README documentation for traceable project updates.
Annotate data and review transcriptions for linguistic accuracy, completeness, and consistency; flag ambiguous inputs.
Produce and review Brazilian Portuguese audio for clarity, pronunciation, pacing, noise, and specification compliance.
Reconcile invoices, financial records, budgets, and accounts payable/receivable; investigate discrepancies.
Review case records, calculations, and supporting documents; identify inconsistencies and document evidence.