Medical Coding jobs
- SiemensHybrid work in Kitchener, ON
- $100,000–$150,000 a year
- Full-time
- This means that you will be working with the whole team on the challenge of validating the system quality.
- You build the test infrastructure, the contract tests…
- CapgeminiMississauga, ON
- $45,000–$65,000 a year
- Permanent
- Support coding, debugging, unit testing, and deployment activities in accordance with project standards.
- Utilize cloud platforms (Azure, AWS, GCP) and big data…
- EricssonToronto, ON
- $80,500–$105,525 a year
- Practical experience using a large language model or AI coding assistant to support a technical task.
- Ericsson offers excellent health benefits including the…
- View all Ericsson jobs - Toronto jobs
- Salary Search: AI & Cloud Services Professionals salaries
- See popular questions & answers about Ericsson
- EricssonOttawa, ON
- $83,000–$111,300 a year
- Experience with wireless communication fundamentals, such as quadrature modulation, channel coding, OFDMA, and receiver theory.
- View all Ericsson jobs - Ottawa jobs - Junior Software Engineer jobs in Ottawa, ON
- Salary Search: Junior L1 Software Developer salaries in Ottawa, ON
- See popular questions & answers about Ericsson
- Rockwell AutomationHybrid work in Waterloo, ON
- $20–$32 an hour
- Full-time
- C omfort with coding, vibe coding, prototyping, and large language models.
- You will contribute across user experience research, interaction prototyping, and the…
Software Development Engineer II, Omnichannel Metrics (OCM) - Measurement, Ad Tech, and Data Science (MADS)
NewOften replies in 7 daysAmazon Development Centre Canada ULCToronto, ON- $114,800–$191,800 a year
- Full-time
- Paid time off
- Vision care
- Dental care
- Profit sharing
- RRSP
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations…
Clinical Data Management Specialist
Easily applyEverest Clinical ResearchMarkham, ON L3R 0B8- $45,000–$70,000 a year
- Permanent
- Tuition reimbursement
- Paid time off
- Vision care
- Dental care
- Employee assistance program
- Disability insurance
- Assist in resolving data coding discrepancies resulting from the coding of medical events, procedures, and medications.
Medical Receptionist (Family Health Team)
Easily applyCarefirst Seniors & Community Services AssociationToronto, ON- $37,000–$42,000 a year
- Full-time
- Weekends as needed +1
- Dental care
- Extended health care
- Knowledge of OHIP billing and coding.
- Responsible for booking appointments, scheduling patients, and providing follow-up; answering the phones, photocopying,…
- General Dynamics Land SystemsLondon, ON N5V 2Z7
- $27.25–$27.75 an hour
- Demonstrated experience with RPA utilizing Automation Anywhere (preferred), and potentially other coding including but not limited to Python, C++, C#,…
Administrative Assistant
Easily applyNewADECCOSaint John, NB- $24.50 an hour
- Contract +1
- Dental care
- Assign parts and labor costs using VMRS (Vehicle Maintenance Reporting Standards) coding.
- You will support maintenance operations by managing work orders,…
Python Developer
Easily applyWISSEN TECHNOLOGY PRIVATE LIMITEDMontréal, QC- Full-time
- Monday to Friday
- Paid time off
- Vision care
- Dental care
- Life insurance
- Disability insurance
- Extended health care
- Healthcare insurance for you and your family (medical, dental, vision).
- Follow best practices for coding, security, deployment, and production support.
Claims Examiner
Easily applyMSH International (Canada) Ltd.Remote in Canada- $48,000–$52,000 a year
- Full-time
- Monday to Friday +3
- Tuition reimbursement
- Paid time off
- Vision care
- Dental care
- Employee assistance program
- Disability insurance
- Experience with medical coding standards.
- You thrive in a fast-paced environment providing excellent customer service in both the turnaround of the claim and…
Technology Developer
Easily applyPurolator IncMississauga, ON- Write unit tests and follow coding standards to support software quality.
- Purolator International provides a “Best in Class” Total Rewards package to employees…
- View all Purolator Inc jobs - Mississauga jobs - Developer jobs in Mississauga, ON
- Salary Search: Technology Developer salaries in Mississauga, ON
- See popular questions & answers about Purolator Inc
Technology Developer
Easily applyPurolator IncMississauga, ON- Write unit tests and follow coding standards to support software quality.
- Purolator International provides a “Best in Class” Total Rewards package to employees…
- View all Purolator Inc jobs - Mississauga jobs - Developer jobs in Mississauga, ON
- Salary Search: Technology Developer salaries in Mississauga, ON
- See popular questions & answers about Purolator Inc
- Amazon Development Centre Canada ULCToronto, ON
- $171,400–$286,200 a year
- Full-time
- Guide teams in software engineering practices for the full software development life cycle, including coding standards, code reviews, source control management,…
- Amazon Development Centre Canada ULCVancouver, BC
- $114,800–$191,800 a year
- Full-time
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations…
By creating a job alert, you agree to our Terms . You can change your consent settings at any time by unsubscribing or as detailed in our terms.
People also searched:
Career Resources:
Job Post Details
Agentic Evaluation & Testing Specialist, Kitchener, ON
Agentic Evaluation & Testing Specialist, Kitchener, ON
Job details
Full job description
Change the future with us.
We are looking for dedicated and talented people who solve ever-changing challenges, customer needs, and questions from colleagues with clever concepts and creativity. We embrace change and work with curious minds re-inventing the future of work. Join us and let us focus together on what’s truly important: making lives better with new ideas and the latest technology around the world.
About the role: System Testing and Agent Evaluation Specialist
We are seeking a System Testing and Agent Evaluation Specialist to join Siemens Digital Industries Operations Software at our AI hub in Canada. You make change verifiable in a product that is built AI-first: much of our code, tests, and documentation are produced by coding agents under the direction of engineers. This means that you will be working with the whole team on the challenge of validating the system quality.
You build the test infrastructure, the contract tests between components developed at our global sites, and the evaluation methods for agent behavior that cannot be judged by a simple pass or fail. You work with the industrial experts in Europe who define what a correct outcome looks like on a shop floor, and with the developer platform team that runs your tests at scale. This is a software engineering role for someone who thinks in terms of evidence and problem solving, not a manual testing role.
The role covers two separate workstreams with one underlying discipline. First, you are responsible for the verification of the product itself, covering classical software testing of a distributed, multi-site system. Second, you are responsible for building an evaluation workflow into the product that allows it to test and verify its own agent-generated output: new skills, prompts, and agent configurations are assessed for correctness, safety, performance, and cost in a controlled environment before a human decides whether to activate them. The first workstream is how we build the product; the second is a product feature our customers rely on.
About Siemens Digital Industries Operations Software: It is a suite of integrated digital solutions to engineer, simulate and operate manufacturing operations across industries. Operations Software includes our product portfolio in manufacturing engineering (COMOS, Tecnomatix, NX CAM, ...) & production operations (Win CC, Scada, PCS 7 / neo, Opcenter, Insights Hub, ...). The portfolio helps organizations across many different industries to improve operational efficiency, reduce costs, and enhance decision-making by providing real-time visibility and control across manufacturing and business processes.
Formula 1 cars, ships, mobile phones, space exploration vehicles, food & beverages, pharmaceuticals and many of the other objects we see in our daily lives are being conceived and produced using our software.
We're redefining the industrial world using data and AI to make production: Agile, Adaptive, Autonomous. Eliminate productivity boundaries for today’s and tomorrow’s production operation. Join our mission to build the most comprehensive next generation AI-native Industrial Operations Software portfolio as the new operation system for industry in the age of AI. With us you have the chance to now apply AI to where it really matters: In the physical world of an industrial production and engineering of real things.
As part of Siemens Operations Software (OPS-SW), the Technology, Data Fabric & Agentic AI organization provides the technology foundation that enables the next generation of industrial software. Its portfolio includes AI Production & Engineering Systems, Data Fabric, Agentic AI frameworks, connectivity platforms, semantic data models, cloud-native architectures, and industrial AI services that power autonomous, scalable, and intelligent operations across the OPS-SW portfolio.
What will you do?
- Build automated test infrastructure for a product developed across multiple sites, covering cross-component contract tests and integration and end-to-end tests against deployed systems.
- Design evaluation methods for agent behavior that a pass/fail assertion cannot capture: task completion, permission compliance, error handling, latency, and cost, measured over repeated runs and compared against the active version.
- Build the assessment workflow into the product itself, so that agent-generated skills, prompts, and configurations are evaluated in isolated environments before a human decides whether to activate them.
- Integrate the security checks defined by product security into that workflow, so that every artifact is assessed for correctness and containment in one run with two separate verdicts.
- Keep test expectations independent of the implementation, so that generated code and generated tests cannot confirm the same wrong assumption, and reject agent-generated tests that prove nothing.
- Make results usable by the product's own improvement loop as well as by human approvers, without letting anything bypass approval.
- Work AI-first: use coding agents for test development and failure analysis, and own the judgment about what the results mean.
What you will bring?
- Degree in computer science, software engineering, or a related field, or equivalent experience.
- 4+ years in software engineering with a focus on test automation, test infrastructure, or verification of distributed systems; you write production-quality code.
- Experience designing test strategies for systems with asynchronous behavior, external dependencies, and non-reproducible components.
- Practical experience with LLM-based applications and an understanding of why conventional assertions are not enough to evaluate them.
- Experience building evaluation pipelines or quality gates that run as part of a product or platform, not only in a developer's CI.
- Familiarity with contract testing, API schema validation, and CI/CD integration of test suites.
- Solid Python; comfortable with containerized test environments and Kubernetes-based execution.
- The instinct to ask "how would we know if this were wrong" before asking "does it pass".
What sets you apart?
- Experience with agent evaluation frameworks and AI observability tooling (Langfuse, LangSmith, Promptfoo, or comparable).
- Experience with property-based testing, metamorphic testing, or statistical test methods for nondeterministic systems.
- Background in safety-relevant or regulated software where test evidence is an audit artifact and release decisions are documented.
- Experience with simulation-based testing or hardware-in-the-loop setups.
- Exposure to industrial systems (MES, SCADA, OPC UA) and an understanding of what a wrong action costs on a shop floor.
- Experience designing systems that evaluate other AI systems, including LLM-as-judge setups and their known failure modes.
- Comfortable working with distributed teams across time zones and communicating asynchronously by default.
Salary is commensurate with experience, and ranges between $ 100,000 CAD - $ 150,000 CAD, excluding bonus and benefits. In addition to base salary, this role includes eligibility for an annual discretionary bonus of 10%.
Why you’ll love working for Siemens!
Join our Digital World
At Siemens Digital Industries Operations Software, flexibility is how we work – hybrid, built on trust and autonomy. We build technology that shapes the real world. You'll grow through real projects, strong technical peers, and global mobility, backed by the scale and benefits of an industrial operations software leader. We're committed to equality and inclusion, and we hire based on merit, skills, and impact. Bring your curiosity and creativity and help us shape tomorrow!
Our Benefits & Rewards
The actual compensation offered is based on the successful candidate's job-related skills, experience, and relevant education/training. Siemens offers a wide range of health and wellness benefits to employees
Our Commitment to Equity and Inclusion
We value equal opportunities and welcome applications from people with disabilities. At Siemens, we believe people who've had real experiences dealing with being different will excel as leaders. Let's foster a culture of creativity and innovation. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Siemens is proud to be an eight-time award winner of Canada’s Top 100 Employers, Canada’s Greenest Employers 2025 and Canada’s Top Employers for Young People 2025.
About us.
We share our ideas and champion the people behind them.
Siemens Canada is a leading technology company focused on industry, infrastructure, mobility and healthcare. The company’s purpose is to create technology with purpose, transforming the everyday, for everyone, since 1912. By combining the real and the digital worlds, Siemens empowers its customers to accelerate their digital and sustainability transformations, making factories more efficient, cities more liveable, and transportation more sustainable. Siemens also owns a majority stake in the publicly listed company Siemens Healthineers, a leading global medical technology provider pioneering breakthroughs in healthcare. For everyone. Everywhere. Sustainably.
In fiscal 2024, which ended September 30, 2024, Siemens Canada had revenues of approx. $2.2 billion CAD. The company has approximately 4,400 employees from coast-to-coast and 37 office and production facilities across Canada.
To learn more about Siemens Canada, visit our website at www.siemens.ca
While we appreciate all applications we receive, we advise that only candidates under consideration will be contacted.
#OneOpsSW #LI-Hybrid
Canada