Nguyen (Will) Nguyen

Currently, I am an Applied Scientist at Aitomatic. I graduated with a master's degree from the University of Rochester, where I was advised by Professor Chenliang Xu. During my time at the University of Rochester, I worked on instructional video understanding and vision-language problems.

I had nearly 3 wonderful years at VinAI Research where I worked on the scene text spotting problem under the supervision of Professor Nguyen Minh Hoai. I completed my bachelor's degree at the University of Engineering and Technology - VNU, where I had the opportunity to work with Professor Hoang Van Xiem.

Email  /  CV  /  Bio  /  Google Scholar  /  Twitter  /  Github

I'm interested in computer vision, natural language processing, and machine learning (especially deep learning). Much of my research lies in optical character recognition, focusing on scene text recognition. I am also fond of Vision-Language problems, such as understanding visual content using natural language. Recently, I am working on developing domain-specific foundation models for industry.

An unified multimodal LLM designed for comprehensively solving all tasks related to egocentric video understanding.

A new task of understanding the state of objects and the progression of object state changes. Besides, we trained a Multimodal-LLM that significantly surpasses previous state-of-the-art models. Our model achieved 90% quality of GPT4-V on both GPT4 and human evaluations.

A simple but effective approach to incorporate language knowledge from large text corpus for improving both text detection and recognition.

A comprehensive system designed to guide humans to work more efficiently and accurately. Our system leverages the power of LLMs to interpret and process information from visual, auditory, and contextual dimensions.

A novel approach to incorporate dictionary on both training and testing phases. Additionally, we also introduced a novel Vietnamese scene text dataset (VinText), the largest scene text dataset for Vietnamese.

Reviewer
WACV 2022, CVPR 2023, CVPR 2024, ACMMM 2024

Competition jury member (2021)
Ho Chi Minh city AI Challenge 2021: Vietnamese Scene Text Recognition

Teaching assistant (2018 - 2019)
University of Engineering and Technology - Vietnam National University
Teaching assistant in several computer vision and machine learning courses for Samsung Display Vietnam’s staff