About the role
structured by ORIBack Besimple AI ### Linguist - Speech & Conversational AI Remote Contract Visa Sponsorship ### About the role Besimple AI is building datasets, benchmarks, and training environments that help voice models understand people, interact naturally, and complete real tasks. We’re looking for a linguist to help define and…
What you will do
- Evaluate speech and conversational quality, including pronunciation, intelligibility, prosody, pacing, tone, and turn-taking.
- Build quality standards and evaluation rubrics from customer requirements and feedback.
- Screen and support speech contributors by designing auditions, evaluating recordings, and giving actionable feedback.
- Create and review linguistic annotations, guidelines, and reference examples.
- Improve conversational tasks and model evaluation by refining scenarios, instructions, and turn-level rubrics.
What they are looking for
- A background in linguistics, speech science, phonetics, phonology, or a related field, through academic study or substantial applied experience.
- Strong listening and analytical skills, with the ability to describe specific features of speech and explain how they affect meaning, clarity, and naturalness.
- Experience with speech data, linguistic annotation, transcription, language assessment, or conversational analysis.
- The ability to turn nuanced judgments into guidelines that other people can apply consistently.
- Clear written communication and comfort giving specific, constructive feedback.
- Careful judgment about ambiguity, language variation, and the difference between personal preference and a task’s actual requirements.
Nice to have
- Evaluating text-to-speech, speech recognition, speech-to-speech, or conversational AI systems.
- Prosody, pragmatics, discourse analysis, sociolinguistics, or conversation analysis.
- Praat, ELAN, phonetic transcription, or other speech-analysis and annotation tools.
- Designing annotation schemes, building reference datasets, or measuring agreement between reviewers.
- Speaker auditions, voice coaching, or evaluating spoken performance.
- Working with multilingual datasets or collaborating with linguists across languages.
- Basic scripting or data analysis for investigating annotation quality and recurring errors.
Benefits
- You’ll help shape the standards behind the data that voice models learn from.
- This is an opportunity to apply linguistic expertise directly to the development of conversational AI, with ownership over both the quality of individual examples and the processes that make that quality repeatable.
Full posting text
Back
Besimple AI
Linguist - Speech & Conversational AI
Remote
Contract
Visa Sponsorship
About the role
Besimple AI is building datasets, benchmarks, and training environments that help voice models understand people, interact naturally, and complete real tasks.
We’re looking for a linguist to help define and improve the quality of the speech and conversations used to train these models. You’ll bring a trained ear for language, an understanding of how people communicate, and the ability to explain what makes a conversation clear, natural, and appropriate to its context.
Your work will connect linguistic expertise with practical decisions: which recordings are suitable for training, how contributors should be evaluated, what annotators should label, and how we measure the behavior of conversational agents.
What you’ll work on
- Evaluate speech and conversational quality. Assess pronunciation, intelligibility, prosody, pacing, tone, and turn-taking in human recordings and model outputs. Explain why a response sounds natural, awkward, overly scripted, or inappropriate for the situation.
- Build quality standards and evaluation rubrics. Translate customer requirements and feedback into clear criteria, examples, and decision rules. Define what reviewers should accept, flag, or reject, including how expectations differ across conversational roles and tasks.
- Screen and support speech contributors. Help design auditions, evaluate recordings, and give actionable feedback on delivery. Identify contributors who can sustain natural conversations while following a scenario’s requirements.
- Create and review linguistic annotations. Develop guidelines and reference examples for transcripts, speaker turns, speech delivery, and conversational behavior. Review human and model-generated labels, resolve ambiguous cases, and improve consistency across reviewers.
- Improve conversational tasks and model evaluation. Work with researchers to refine scenarios, instructions, and turn-level rubrics. Identify unclear wording or grading criteria, and distinguish real model failures from problems in the task itself.
- Turn recurring problems into better workflows. Analyze disagreements and rejection patterns, calibrate reviewers, and improve guidance in the crowdsourcing platform we build. Partner with engineers and audio specialists to separate language and delivery issues from recording defects.
What we’re looking for
- A background in linguistics, speech science, phonetics, phonology, or a related field, through academic study or substantial applied experience.
- Strong listening and analytical skills, with the ability to describe specific features of speech and explain how they affect meaning, clarity, and naturalness.
- Experience with speech data, linguistic annotation, transcription, language assessment, or conversational analysis.
- The ability to turn nuanced judgments into guidelines that other people can apply consistently.
- Clear written communication and comfort giving specific, constructive feedback.
- Careful judgment about ambiguity, language variation, and the difference between personal preference and a task’s actual requirements.
We welcome recent graduates with relevant research or substantial projects, as well as linguists with industry experience. Research, annotation guidelines, evaluation studies, and examples of applied linguistic work are all useful evidence.
Especially relevant experience
- Evaluating text-to-speech, speech recognition, speech-to-speech, or conversational AI systems.
- Prosody, pragmatics, discourse analysis, sociolinguistics, or conversation analysis.
- Praat, ELAN, phonetic transcription, or other speech-analysis and annotation tools.
- Designing annotation schemes, building reference datasets, or measuring agreement between reviewers.
- Speaker auditions, voice coaching, or evaluating spoken performance.
- Working with multilingual datasets or collaborating with linguists across languages.
- Basic scripting or data analysis for investigating annotation quality and recurring errors.
You do not need experience in every area listed above.
Why this role
You’ll help shape the standards behind the data that voice models learn from. Your judgments will influence how we collect conversations, select speakers, evaluate model behavior, and improve the quality of our datasets.
This is an opportunity to apply linguistic expertise directly to the development of conversational AI, with ownership over both the quality of individual examples and the processes that make that quality repeatable.
About Besimple AI
Voice data for AI
Other roles at Besimple AI
•
RL Environment Engineer (Full-time, Part-time, or Contract)
RemoteFull-time
•
Community Growth Manager, Contributor Acquisition
RemoteContract
•
Strategic Projects Lead — Audio Data
San Mateo, CAFull-time
•
Audio QA Lead - Part Time Contractor
RemoteContract
Interested?
Let me introduce you to the founders.
Skip the process
Job details
Salary
$30 - $60
Location
Remote
Experience
3+ years
Company
NameBesimple AI
IndustryB2B
Team Size10
View profile
Funding
Total raised
$3M
Last stage
Seed
Investors
Y Combinator
Founders
Bill Wang
Yi Zhong
What happens next.
No applications, no recruiter spam. Just the intro.
01
Confirm the fit
A few questions to make sure this role is the right shape for you. Two minutes.
02
I pitch you to the company
I write the intro, send it to the founder, and handle the back-and-forth.
03
A meeting lands on your calendar
If they’re a yes, I book the chat. You show up — that’s the whole job-hunt.