I am Sergei . I do this:

Master's Thesis and a Google internship: simple world models lead to good abstractions
2019-2021 Credits Details Pictures

SERGEI
brainstorming, coding (100% or 20k SLOC of python3+ray+pytorch), paper writing

JOHANNI BREA, WULFRAM GERSTNER
advising on the thesis at EPFL, brainstorming, paper writing

NEVAN WICHERS, JEREMY NIXON, IVAN VENDROV
advising on the internship at Google, brainstorming, paper writing

Google Research (Mountain View, California, 2019-2020), LCN EPFL (Lausanne, Switzerland, 2020-2021)
funding, whiteboards, infrastructure, dried mangos

My Master's Thesis at EPFL, 2020-2021 «CauseOccam: Learning Interpretable Abstract Representations in Reinforcement Learning Environments via Model Sparsity». Here we show that simple (in terms of number of edges) neural network-based causal models result in interpretable abstract representations.
Project's code implements learning a sparse causal model of an RL environment from pixels in PyTorch. Please note the resource requirements... My library gin-tune integrates gin-config and ray tune.
Our paper from the Google Research internship «Resolving Spurious Correlations in Causal Models of Environments via Interventions». Here we define spurious correlations in RL environments and propose ways to deal with them. Paper was presented at the ICLR CLDM 2020 workshop,

An intermediate version of the project with linear environments was presented at the Machine Learning Summer School 2020 .

Google Internship project: Our method obtains a causal model of an RL environment	Thesis project: learning a simple causal model with interpretable nodes from pixels
Process of learning the causal graph in the thesis project	λ can be seen as annealing temperature, and non-zero components as -quality of the alloy.

DIY Quadcopter controller with an IMU and PIDs on Arduino Due
2011-2014 Credits Details Pictures

SERGEI: coding (95% or 8k SLOC for the Copter, 3k or 100% SLOC for the Oscilloscope, C++/Qt/AVR, C/AVR), debugging, brainstorming, hardware, video editing
ARSHAVIR TER-GABRIELYAN: mentorship, piloting, brainstorming, code review, hardware, funding
DMITRY MIRONOV, VADIM LIVENTSEV : brainstorming, coding, hardware
ANASTASIA DERBENEVA, ALEXANDER DERBENEV, IGOR MOSYAGIN, NINA SELEZNEVA & everyone writing the blog post, public outreach
NINA SELEZNEVA: brainstorming, hardware
MARK SURNIN, GOSHA KRIKUN, GEORGY VINOGRADOV, IVAN SOLOMATIN & many others: brainstorming, piloting, hardware, coding
DMITRY PODLESNYKH, «LETNYAYA SHKOLA» summer school, FINE VILLAGE OF RUCHKI, JINR : a place to work at during the semester and during the summer

Tournesol: byzantine-resilient contributor-driven open-source open-data non-commercial recommender engine
(TLDR: contributors compare pairs of videos and the website aggregates the ratings)
2020-2021 Credits Details Pictures

Initially, we were three co-founders:

LÊ NGUYÊN HOANG
algorithm design, open discussions, public outreach, president of the Tournesol association 🇨🇭

SERGEI
development (machine learning, backend, frontend; 90% or 13k SLOC total of python3-django and js-react), open discussions, algorithm design, ranting on Discord

LOUIS FAUCON
development (frontend, backend), open discussions

At the current stage I am not actively involved, and the project is with EPFL.

Defending against adversarial policies in Reinforcement Learning via alternating training
2020 Credits Details Pictures

SERGEI
coding (100% or 6k SLOC of python3+ray+rllib), brainstorming, writing the blog post

ADAM GLEAVE
brainstorming, advising, writing the blog post

UNIVERSITY OF CALIFORNIA, BERKELEY; CENTER FOR HUMAN-COMPATIBLE AI
infrastructure, funding

One complex escape room hardware/software & One b2b project for escape rooms
2014-2016 Credits Details Pictures

«A Beautiful Mind» escape room, 2014
ANDREY GLINSKY, GALYA TENISHEVA, MARIYA KAPLUN: escape room owners, plot, clues, and riddles
SERGEI: main software/hardware engineer (100% or 15k SLOC of C++), blog post, video editing
DMITRY BARNYSHEV, DMITRY SNISARENKO, GRIGORY LAVRENTYEV, GENNADY : hardware, brainstorming, installing hardware into the escape room

---

EscapeControl, a b2b escape room project
SERGEI: owner, lead software engineer (backend/frontend, 50% or 13k SLOC of C++, python3-bottle), public outreach, technical support
IGOR MOSYAGIN (30% SLOC for front), BOGDAN BAGNO (38% SLOC for front): frontend engineering, technical support