Projects @ UC Berkeley:
Deep Reinforcement Learning

Deep reinforcement learning with the Advantage Actor-Critic (A2C) model. In addition to standard A2C, proximal policy optimization (PPO) is also implemented. As discussed in the original paper, PPO provides better stability by preventing the policy from changing too much during each update. The models are evaluated on multiple tasks from OpenAI gym. Code available soon!

Neural Artistic Style

Here is a neural network that creates stunning artistic images! This project replicates the result in "A Neural Algorithm of Artistic Style", Gatys et al. 2015. A deep neural network is trained using TensorFlow to create new artistic images by recombining styles and contents from different inputs. Code available on GitHub.

The neural network used in this project is based on a VGG16 model pre-trained on ImageNet. The model is available here.

Neural Poet
Neural Poet 

Use a Recurrent Neural Network (RNN) to generate classic Chinese poems! This project uses a Sequence-to-Sequence model inspired by this TensorFlow tutorial.

Currently, the model has learned from over 200,000 lines of original poems. Check out this interactive web app:

Code available soon. Enjoy!

Agile Robot Navigation with Floor Plan

One thing that prevents a robot from navigating in an indoor space is that it lacks an accurate map. While we can certainly use SLAM to generate such a map, this is extremely costly as the robot needs to scan the space every time it arrives in a new environment. In this project, I combined particle filtering with AR tag recognition so that the robot can navigate with an inaccurate floor plan.

Robotic Platform for Air-Change Effectiveness Assessment 

Standard approach for measuring air-change effectiveness requires multiple sensor stations to be installed. The calibration and deployment of these sensors become a daunting task, especially when the space is big. In this project, we propose and evaluate an alternative profiling method of indoor ventilation efficiency based on autonomous robotic platform.  [Paper] [Poster]