Avatar

Tony Joseph

Machine Learning Engineer

tjoseph_dot_ubc_at_gmail_dot_com

I completed MSc. in Computer Science under the supervision of Prof. Faisal Qureshi and Prof. Kosta Derpanis. I have been working at the intersection of deep learning and computer vision. My research interests mainly lie in the areas of computer vision, machine learning, Bayesian inference, and generative models.

Education

  • MSc. in Computer Science, 2019

    University of Ontario Institute of Technology

  • BEng. in Electrical Engineering, 2016

    University of Ontario Institute of Technology

News

Sept. 6, 2021
Starting a new position at Conestoga College as an Adjunct Professor.
Aug. 3, 2021
Starting a new position at Patagona Technologies as Machine Learning Engineer.
Dec. 16, 2019
Starting a new position at PLAI Lab as Machine Learning Engineer at University of British Columbia.
Aug. 25, 2019
One paper accepted to the Advances in Image Manipulation (AIM) workshop at International Conference on Computer Vision (ICCV) 2019.
July 1, 2019
One paper accepted as spotlight to the British Machine Vision Conference (BMVC) 2019.
June 28, 2019
Attended SciNet-HPC summer school. It was great introduction to CUDA programming.
May 30, 2019
Successfully defended my M.Sc. thesis! Thank you to my advisors: Faisal Qureshi and Kosta Derpanis for their support and guidance.
May 3, 2019
Presented our work on Joint Spatial and Layer Attention at Southern Ontario Numerical Analysis Day (SONAD).
July 14, 2018
Attended International Computer Vision Summer School (ICVSS-2018). Thank you to all the organizers for making it a fun and educational event.

Publications

This work presents Ensemble Squared, a "meta" AutoML system that ensembles at the level of AutoML systems. Ensemble Squared exploits the diversity of existing, competing AutoML systems by ensembling the top-performing models simultaneously generated by a set of them. Our work shows that diversity in AutoML systems is sufficient to justify ensembling at the AutoML system level.
arXiv 2020
                              @inproceedings{yoo2019ensemble,
                                    title={Ensemble Squared: A Meta AutoML System},
                                    author={Jason, Yoo and Joseph, Tony and Yung, Dylan and Nasseri, Ali and Wood, Frank},
                                    journal={arXiv preprint},
                                    year={2020},
                              }
                          

This work proposes a two stage adversarial model EdgeConnect that comprises of an edge generator followed by an image completion network. The edge generator hallucinates edges of the missing region (both regular and irregular) of the image, and the image completion network fills in the missing regions using hallucinated edges as a priori.
arXiv 2019 (accepted at ICCV-AIM workshop 2019)
                                @inproceedings{nazeri2019edgeconnect,
                                      title={EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning},
                                      author={Nazeri, Kamyar and Ng, Eric and Joseph, Tony and Qureshi, Faisal and Ebrahimi, Mehran},
                                      journal={arXiv preprint},
                                      year={2019},
                                }
                            

In this work, we propose a novel approach that learns to sequentially attend to different Convolutional Neural Networks (CNN) layers (i.e., “what” feature abstraction to attend to) and different spatial locations of the selected feature map (i.e., “where”) to perform the task at hand.
arXiv 2019 (accepted at BMVC 2019, Spotlight)
                                    @inproceedings{joseph2019JSLAN,
                                          title={Joint Spatial and Layer Attention for Convolutional Networks},
                                          author={Joseph, Tony and Derpanis, Konstantinos and Qureshi, Faisal},
                                          journal={Conference on the British Machine Vision Association (BMVC), 2019},
                                          year={2019},
                                    }
                                

Joint Spatial and Layer Attention for Convolutional Networks
Abstract: In this work, we propose a novel approach that learns to sequentially attend to different Convolutional Neural Networks (CNN) layers (i.e., “what” feature abstraction to attend to) and different spatial locations of the selected feature map (i.e., "where") to perform the task at hand. Specifically, at each Recurrent Neural Network (RNN) step, both a CNN layer and localized spatial region within it are selected for further processing. We demonstrate the effectiveness of this approach on two computer vision tasks: (i) image-based six degree of freedom camera pose regression and (ii) indoor scene classification.
e-scholar@UOIT (Electronic Theses and Dissertations, 2019)
                                @inproceedings{joseph2019JSLAN,
                                      title={Joint Spatial and Layer Attention for Convolutional Networks},
                                      author={Joseph, Tony},
                                      journal={Electronic Theses and Dissertations (Public), 2019},
                                      year={2019},
                                }
                            

Industry Experience

Auguest, 2021 - present
Machine Learning Engineer at Patagona Technologies.
December, 2019 - July, 2021
Machine Learning Engineer at PLAI Lab.
July, 2017 - November, 2017
Computer Vision Developer at SPXTRM AI Inc.