5. Search Quality Analyst job – MindMeld – San Francisco, CA

5. Search Quality Analyst


San Francisco, CA

About This Role


At MindMeld, we build AI applications that customers really care about and that can be built today utilizing large scale machine learning and natural language understanding. Our Conversational AI platform has been 5 years in the making and is already powering conversational experiences for Fortune 500 companies. One of the key components of this is being able to collect, manage and quality-check training data on a large scale. As a Search Quality Analyst, you will work closely with the engineering team and be responsible for measuring and reporting on the search quality of applications built on our Conversational AI platform. As an early member of the team, you’ll have the unique opportunity to have a large impact and make significant contributions to shaping the direction of the team and the company.

About You


You thrive in an agile development process. You look forward to working in a high caliber team of machine learning and natural language processing experts. You will be part of the team that measures and improves on the quality of our conversational experiences built on top of our AI platform. You will use crowdsourcing tools like Amazon Mechanical Turk for data collection and management. Your work will help us train machine-learning algorithms to improve natural language understanding, information retrieval relevance and natural language reply generation. You’re self-driven and set high expectations for yourself. You take ownership and sweat the small stuff. You thrive on constructive feedback.



  • Own and be responsible for measuring the search quality of applications built on MindMeld’s conversational AI platform
  • Analyze end-to-end accuracy problems reported internally or externally, figure out what part of our system may be responsible, and work with the team to resolve quality issues
  • Assist the engineering team in building training and test datasets
  • Build and manage data ground-truthing processes
  • Produce regular reports on search quality to enable stakeholders to make effective decisions



  • Bachelor’s degree or higher from an accredited institution
  • 2+ years of relevant industry experience
  • Experience with scripting (e.g. Python) and/or web pages (HTML, CSS, Javascript) is a plus
  • Experience using crowdsourcing tools like Amazon Mechanical Turk is a plus
  • Excellent analytical capabilities and ability to make decisions quickly
  • Passion for data
  • Detail-oriented
  • Excellent at written and oral communication

original job

» Apply Now

Please review all application instructions before applying to MindMeld.

MindMeld has pioneered the AI technology behind the emerging generation of intelligent voice and chat assistants. MindMeld currently powers…

About secureteam

A Computer Programmer whose articles got mentions from the likes of The New York Times, Kissmetrics and AllTopStories. He writes articles, novels and poems; spends most of his time reading everything he could get his hands on. He is currently pursuing his Masters from The University of Illinois and holds a Bachelors in Electronics Engineering from the University of California. He is a programmer, a motivational writer and speaker.

Leave a Reply

Your email address will not be published. Required fields are marked *