<p>Deep Reinforcement Learning: With Dr. Zacharski I focused more on a particular instance of Reinforcement Learning where deep neural networks are used. During this time, I built out a Reinforcement Learning library written in PyTorch. This library helps me have a test bed for trying out different algorithms and attempts to create my own.</p>
<p>Reinforcement Learning: Currently studying the fundamentals of reinforcement learning with Dr. Davies. We went over the fundamentals such as value functions, policy functions, how we can describe our environment as a markov decision processes, etc.</p>
<p><ahref="index.html%3Fresearch%252FReinforcementLearning.html">Notes and Other Goodies</a></p>
<p>Programming Languages: Studying the design of programming languages. So far I made an implementation of the SLOTH programming language, experimenting with what I want my own programming language to be syntatically and paradigm wise.</p>
<p>Competitive Programming: Studying algorithms and data structures necessary for competitive programming. Attending ACM ICPC in November with a team of two other students.</p>
<h2>Math/Statistics Research</h2>
<p>Worked on an independent study on the topic of <strong>Cluster Analysis</strong>. This is where you try to group similar observations without knowing what the labels are.
I am studying under the guidance of Dr. Melody Denhere, the link below gives you more of a description of the project along with my course notes.</p>
<p><ahref="index.html%3Fresearch%252FClusterAnalysis.html">Cluster Analysis Spring 2018</a></p>
<h2>Physics Research</h2>
<p>For the two projects below, I worked on Quantum Research in a physics lab with a fellow student Hannah Killian and an advisor Dr. Hai Nguyen. I mostly assisted with the software support for the project and assisted in the mathematics in whatever way I can.</p>
<p><ahref="/files/research/modellingpopulationdynamics.pdf">Modeling Population Dynamics of Incoherent and Coherent Excitation</a></p>
<p><ahref="/files/research/coherentcontrolofatomicpopulation.pdf">Coherent Control of Atomic Population Using the Genetic Algorithm</a></p>
<p>In order to circumvent the frustrations I had with simulation code taking a while, I applied and received funding to build out a Beowulf cluster for the Physics department. Dr. Maia Magrakvilidze was the advisor for this project.</p>
<p><ahref="/files/research/LUNAC.pdf">High Performance Cluster for Research and Education Report (nicknamed LUNA-C)</a></p>