Avatar

Tony Joseph

AI Engineer

🧠🤖🔧

Hello, I’m Tony 👋
Welcome 🎉 to my corner of the Web! I’m thrilled you’re here 😊

TL;DR I’m a Machine Learning Engineer & Software Developer with a deep passion for all things AI. From startups to leading roles in Big Tech, I’ve had the privilege of building and scaling end-to-end ML systems that power real-world products and experiences.
My mission? To turn cutting-edge research into production-ready solutions—with performance, scalability, and impact at the core. Have a look around, explore my work, and feel free to connect. Let’s build the future, one model at a time. 🚀

Interests

  • Artificial Intelligence
  • Machine Learning
  • Data Science
  • Software Development

Education

  • MSc Icon

    MSc. in Computer Science, 2019

    University of Ontario Institute of Technology

  • BEng Icon

    BEng. in Electrical Engineering, 2016

    University of Ontario Institute of Technology

  • Nanodegree Icon

    Nanodegree in Self-Driving Car, 2017

    Udacity

Latest News

Feb. 26, 2024
Proud to team up with the Mayo Clinic to develop the future of AI-driven physician assistant systems.
Sept. 6, 2022
Starting a new position at Conestoga College as a Professor.
Aug. 3, 2021
Starting a new position at Patagona Technologies as Machine Learning Engineer.
Dec. 16, 2019
Starting a new position at PLAI Lab as Machine Learning Engineer at the University of British Columbia.
Aug. 25, 2019
One paper accepted to the Advances in Image Manipulation (AIM) at International Conference on Computer Vision (ICCV) 2019.
July 1, 2019
One paper accepted as spotlight to the British Machine Vision Conference (BMVC) 2019.
June 28, 2019
Attended SciNet-HPC summer school. It was great introduction to CUDA programming.
May 30, 2019
Successfully defended my M.Sc. thesis! Thank you to my advisors: Faisal Qureshi and Kosta Derpanis for their support and guidance.

📚 Publications

This work presents Ensemble Squared, a "meta" AutoML system that ensembles at the level of AutoML systems. Ensemble Squared exploits the diversity of existing, competing AutoML systems by ensembling the top-performing models simultaneously generated by a set of them. Our work shows that diversity in AutoML systems is sufficient to justify ensembling at the AutoML system level.
arXiv 2020 (submitted to DARPA-D3M research under AutoML Infrastructure)
                              @inproceedings{yoo2019ensemble,
                                    title={Ensemble Squared: A Meta AutoML System},
                                    author={Jason, Yoo and Joseph, Tony and Yung, Dylan and Nasseri, Ali and Wood, Frank},
                                    journal={arXiv preprint and D3M Papers},
                                    year={2020},
                              }
                          

This work proposes a two stage adversarial model EdgeConnect that comprises of an edge generator followed by an image completion network. The edge generator hallucinates edges of the missing region (both regular and irregular) of the image, and the image completion network fills in the missing regions using hallucinated edges as a priori.
arXiv 2019 (accepted at ICCV-AIM 2019)
                                @inproceedings{nazeri2019edgeconnect,
                                      title={EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning},
                                      author={Nazeri, Kamyar and Ng, Eric and Joseph, Tony and Qureshi, Faisal and Ebrahimi, Mehran},
                                      journal={arXiv preprint},
                                      year={2019},
                                }
                            

In this work, we propose a novel approach that learns to sequentially attend to different Convolutional Neural Networks (CNN) layers (i.e., “what” feature abstraction to attend to) and different spatial locations of the selected feature map (i.e., “where”) to perform the task at hand.
arXiv 2019 (accepted at BMVC 2019, Spotlight)
                                    @inproceedings{joseph2019JSLAN,
                                          title={Joint Spatial and Layer Attention for Convolutional Networks},
                                          author={Joseph, Tony and Derpanis, Konstantinos and Qureshi, Faisal},
                                          journal={Conference on the British Machine Vision Association (BMVC), 2019},
                                          year={2019},
                                    }
                                

Joint Spatial and Layer Attention for Convolutional Networks
Abstract: In this work, we propose a novel approach that learns to sequentially attend to different Convolutional Neural Networks (CNN) layers (i.e., “what” feature abstraction to attend to) and different spatial locations of the selected feature map (i.e., "where") to perform the task at hand. Specifically, at each Recurrent Neural Network (RNN) step, both a CNN layer and localized spatial region within it are selected for further processing. We demonstrate the effectiveness of this approach on two computer vision tasks: (i) image-based six degree of freedom camera pose regression and (ii) indoor scene classification.
e-scholar@UOIT (Electronic Theses and Dissertations, 2019)
                                @inproceedings{joseph2019JSLAN,
                                      title={Joint Spatial and Layer Attention for Convolutional Networks},
                                      author={Joseph, Tony},
                                      journal={Electronic Theses and Dissertations (Public), 2019},
                                      year={2019},
                                }
                            

🧗‍♂️ Career Journey

Company Logo
January 2024 – November 2024 Software (ML) Engineer

CitiusTech Inc.

  • Patterned with Mayo Clinic on AME-Next project,
    developing the next-generation doctor’s assistant.

Company Logo
January 2023 – April 2023 Machine Learning Developer

AltaML Inc.

Company Logo
September 2022 – February 2024 Professor

Conestoga College

Company Logo
December 2019 – July 2021 Machine Learning Engineer

PLAI LAB, UBC

About Me 💬

I'm a Machine Learning Engineer with a passion for building smart, scalable systems that bring cutting-edge AI research to life.

I completed my MSc. in Computer Science under the supervision of Prof. Faisal Qureshi and Prof. Kosta Derpanis, where I explored the intersection of deep learning and computer vision. My research focused on attention models for convolutional architectures and image inpainting using edge-aware learning — in other words, teaching machines to “fill in the blanks” and see with focus.

Currently, I’m working as a Machine Learning Engineer at a Big Tech company, helping build intelligent systems that operate at scale.

When I’m not wrangling models and data, you’ll likely find me:

  • 🏃‍♂️ Going for a run
  • 👨‍👩‍👧‍👦 Spending time with family
  • 🍜 Exploring new cuisines (always open to recommendations!)
Let’s connect and talk AI, food, or anything in between. 🤖✨