About Me

cj-sprite-2.jpg

Over the last few years, I’ve built multiple MCP Servers and tools, an orchestrator, an LLM Eval engine (Judges, Experiments, Dynamic Datasets), CI/CD analysis tools and Developer onboarding apps. I aim to automate every point of friction that a developer experiences, and keep their context switching to a minuimum.

Happy Devs == Productive Devs.



There are things that AI does well and there are things that it absolutely sucks at. Knowing that difference is a science and an art. I help build and onboard the right tools for the job and/or give an early reality check when asking it to do too much with too little context.

I work as a Principal Developer at Autodesk. I’ve been building AI tools (have a pending patent), orchestrators, CLI tools, setting up the infra and paving the path to production (Auth, scaling, verification, validation and all the gnarly stuff included).

I also run TestCreed where we primarily help hyper scaling startups steady ship. We set up Automation tests, CI pipelines, product and AI evaluation. We also have an LLM validating engine that compares LLM models based on the specialized usecases and helps them pick the one that suits specific needs (Performance <> Accuracy <> Cost).


I started my developer career in 2009 building things for fun and money (An inventory/stock tracking app for a Reebok outlet store, a campus match-making app - unfortunately named “CheckMate”). Here is a list of places I’ve been:

2024/2025: Head of QA at Light Consulting Inc . I built Automation Test Stacks, pre prod environments and established QA processes. Focusing on AI in edTech, hiring and deep research domains, I helped 4 products to successfully Get to Market.

2023: I worked as the Lead Software Developer (In Test) at Top Hat, Toronto . Joining as the first SDET in the company, I built the frameworks, GitHub Action pipelines for Test, established design patterns while building out the SDET Team.

2022: I worked as a Senior Engineer at Amazon Canada. As a part of the growing AmazonAds team, I created nodejs based tools that tested the rollout of Advertiser’s self-service video ads (the video ads that you see on Amazon.com). I also led testing of other projects including: the feature that made every ad placement on the Amazon (and affiliate websites) biddable; Forecasting of the effectiveness of various ad delivery algorithms etc.

Prior to Amazon, I was the QA Engineering Lead at VerticalScope Inc, Toronto. My team and I supported quality for ~2,000 forum websites hosted on the Google Cloud Platform that were under the VerticalScope umbrella.

My experience in the industry has been with organisations of varied sizes and domains: FinTech behemoths like BlackRock and Bank of Montreal; Consultancies like Headstrong Capital Markets and Accenture; and self-driven startups (Algo trading).


Contact

contact@cyriljoseph.ca