R-106449 EverHealth - AI Quality and Content Specialist (Remote, Canada)
Mid-level Content Creation role at EverCommerce. Remote, Canada · full-time · CA$55,000–CA$62,000 base.
Growth Roles summary, based on the employer's posting.
What you'll do
- You'll review AI replies in chat and self-service journeys for errors, weak resolutions, missing details, and compliance concerns
- You'll check the knowledge, workflows, and source material behind AI for accuracy, completeness, and alignment with current support policies
- You'll investigate failures caused by content gaps, prompt handling, and unusual cases, then share fixes with Content and Support leaders
- You'll track resolution accuracy, escalations, and customer sentiment through dashboards and use trends to guide improvements
- You'll work with Content, Product, Engineering, and Support to improve AI training, source content, workflows, and safeguards
What you bring
- You can evaluate AI responses against defined quality standards and spot inaccurate, incomplete, or risky outputs
- You can analyze failure patterns and turn findings into practical recommendations for content and product teams
- You can create reporting that monitors AI quality, customer sentiment, containment, and escalation trends
- You can help establish repeatable audits and governance for help content, macros, documentation, and workflow logic
Who this fits
You'll suit a quality-focused role supporting AI experiences across healthcare products and distributed teams. The job is remote anywhere in Canada, with an option to work from an office if you're near one. You must be eligible to work without sponsorship, and occasional travel to Denver or other North American offices may be required.
From the employer
We are building an extraordinary company and looking for talented, energetic, and motivated people to join our team. You can learn more about our Company, Culture and Values here: https://www.evercommerce.com/about-us/careers/
EverHealth, a business within EverCommerce, provides modern end-to-end solutions for healthcare providers. Our open, connected ecosystem of solutions and services helps providers engage patients, increase revenue, improve business efficiency, and remain market competitive. We serve 72,000 healthcare practices and counting. EverHealth consists of five SaaS products; DrChrono, iSalus, CollaborateMD, Updox, and MDTec, combined these products offer end to end solutions for the health care industry.
We are seeking an AI Quality & Content Specialist to ensure the accuracy, reliability, and continuous improvement of our AI support experience. This role will act as the quality gatekeeper; identifying risks, improving performance, and building trust in AI across both customers and internal teams.
This person will also own the ongoing auditing and governance of the knowledge and source content powering AI experiences to ensure outputs remain accurate, trustworthy, and operationally effective.
Key Responsibilities
AI Quality Assurance
Audit AI-generated responses across:
Chat
Cases
Self-service flows
Identify:
Hallucinations and reduce “assumed resolves”
Incomplete answers
Compliance risks
Score AI performance against defined QA frameworks
Audit and validate the knowledge content, workflows, and source materials leveraged by AI systems to ensure responses remain accurate, comprehensive, compliant, and aligned with current product functionality and support policies.
Identify outdated, conflicting, incomplete, or low-confidence content that may negatively impact AI-generated responses and customer experience.
Establish ongoing content governance processes to maintain AI readiness across help center articles, macros, internal documentation, and workflow logic.
Root Cause Analysis
Analyze why AI fails:
Content gaps
Poor prompt handling
Edge cases
Provide actionable insights to:
Content Strategist
Head of Support
Create a feedback loop with Product and Engineering and serve as the voice of the customer
Performance Reporting
Build and maintain dashboards tracking:
Resolution accuracy
Escalation drivers
Customer sentiment (AI vs human)
Surface trends and recommend improvements
Continuous Improvement Loop
Partner with stakeholders to:
Retrain AI
Improve knowledge content
Adjust workflows and guardrails
Help establish a closed-loop AI optimization system.
Partner with Content, Product, Engineering, and Support stakeholders to continuously optimize and maintain AI source content quality.
Create scalable auditing mechanisms to proactively identify content gaps, stale documentation, and areas where AI confidence or resolution quality declines.
Help define standards for AI-consumable knowledge design to improve answer consistency, containment, and customer trust.
Success Metrics (First 12 Months)
Reduction in AI error rate / false positives
Improved AI CSAT and containment rate
Increased AI trust score
Increased adoption of the AI channel
Faster identification of content gaps
Established QA framework for AI governance
Where: Remote, Canada
The EverCommerce team is distributed globally, with teams in the U.S., Canada, the U.K., Jordan, New Zealand, and Australia. With a widely distributed team, we are used to working remotely across different time zones. This role can be based anywhere in Canada – if you’re close to one of our offices, we can set you up in-office or you can work 100% remotely. Please note that you must be eligible to work without sponsorship to qualify for this position, and this role may require travel to our Corporate Headquarters in Denver, Colorado, or to other office locations around North America.
Benefits and Perks:
Flexibility to work where/how you want within your country of employment – in-office, remote, or hybrid
Robust wellness benefits, including an annual wellness stipend
3 weeks of vacation to start, a paid volunteer day of your choosing, plus 2 floating holidays to celebrate anything of significance to you
Employee Stock Purchase Program
Registered Retirement Savings Plan (RRSP) with 4% company match
Compensation: The target base compensation for this position is $55,000 to $62,000 CAD per year in most US locations. Final offer amounts are determined by multiple factors including location, local market variances, and candidate experience and expertise, and may vary from the amounts listed above.
EverCommerce is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, veteran status, or disability status. We look forward to reviewing your credentials and getting to know more about your experience!
Not this one either?
Claude or ChatGPT reads the other 26,734 for you.
Get better matches →