2018-19 New Year review

2018 progress

Research / AI safety:

• Wrote a paper on measuring side effects using relative reachability in May, and presented the results at the ICML GoalsRL workshop and the AI safety summer school. Since then, some new approaches have come out using my method as a baseline :).
• Made a list of 30 specification gaming examples in AI (assembled from several existing lists). Since the list was posted in April, 16 new examples have been contributed through the form (thanks everyone!). The list received some attention on Twitter, and I was interviewed about it by Wired and the Times.
• Was in the top 30% of NeurIPS reviewers.
• Gave talks at the Oxford AI Society, EA Global London, etc.
• Got involved in organizing the upcoming ICLR AI safety workshop, Safe Machine Learning: Specification, Robustness and Assurance.

Rationality / effectiveness:

• Attended the CFAR mentoring workshop in Prague, and started running rationality training sessions with Janos at our group house.
• Started using work cycles – focused work blocks (e.g. pomodoros) with built-in reflection prompts. I think this has increased my productivity and focus to some degree. The prompt “how will I get started?” has been surprisingly helpful given its simplicity.
• Stopped eating processed sugar for health reasons at the end of 2017 and have been avoiding it ever since.
  • This has been surprisingly easy, especially compared to my earlier attempts to eat less sugar. I think there are two factors behind this: avoiding sugar made everything taste sweeter (so many things that used to taste good now seem inedibly sweet), and the mindset shift from “this is a luxury that I shouldn’t indulge in” to “this is not food”.
  • Unfortunately, I can’t make any conclusions about the effects on my mood variables because of some issues with my data recording process :(.
• Declining levels of insomnia (excluding jetlag):
  • 22% of nights in the first half of 2017, 16% in the second half of 2017, 16% in the first half of 2018, 10% in the second half of 2018.
  • This is probably an effect of the sleep CBT program I did in 2017, though avoiding sugar might be a factor as well.
• Made some progress on reducing non-research commitments (talks, reviewing, organizing, etc).
  • Set up some systems for this: a spreadsheet to keep track of requests to do things (with 0-3 ratings for workload and 0-2 ratings for regret) and a form to fill out whenever I’m thinking of accepting a commitment.
  • My overall acceptance rate for commitments has gone down a bit from 29% in 2017 to 24% in 2018. The average regret per commitment went down from 0.66 in 2017 to 0.53 in 2018.
  • However, since the number of requests has gone up, I ended up with more things to do overall: 12 commitments with a total of 23 units of workload in 2017 vs 19 commitments with a total of 33 units of workload in 2018. (1 unit of workload ~ 5 hours)

Advertisements

2017-18 New Year review

2017 progress

Research/career:

• Coauthored RL with reward corruption paper and presented the results at the U Toronto CS department, Workshop on Reliable AI, and Women in ML workshop.
• Coauthored AI Safety Gridworlds paper.
• Gave a talk on Interpretability for AI safety at the NIPS Interpretable ML Symposium.
• Gave a lot of people career advice on getting into AI safety research.

FLI / other AI safety:

• Coorganized the Beneficial AI conference in Asilomar and gave a talk summarizing the work of FLI grantees presented at the Asilomar workshop.
• Cowrote the project examples document for the new grants program.
• Spoke at the Tokyo AI & Society symposium (my first conference in Asia).
• Started a new public Facebook group AI Safety Open Discussion.

Takeaways from self-tracking data

I’ve been collecting data about myself on a daily basis for the past 3 years. Half a year ago, I switched from using 42goals (which I only remembered to fill out once every few days) to a Google form emailed to me daily (which I fill out consistently because I check email often). Now for the moment of truth – a correlation matrix!

The data consists of “mood variables” (anxiety, tiredness, and “zoneout” – how distracted / spacey I’m feeling), “action variables” (exercise and meditation) and sleep variables (hours of sleep, sleep start/end time, insomnia). There are 5 binary variables (meditation, exercise, evening/morning insomnia, headache) and the rest are ordinal or continuous. Almost all the variables have 6 months of data, except that I started tracking anxiety 5 months ago and zoneout 2 months ago.

2016-17 New Year review

2016 progress

Research / career:

• Got a job at DeepMind as a research scientist in AI safety.
• Presented MiniSPN paper at ICLR workshop.
• Finished RNN interpretability paper and presented at ICML and NIPS workshops.
• Attended the Deep Learning Summer School.
• Finished and defended PhD thesis.
• Moved to London and started working at DeepMind.

FLI:

• Talk and panel (moderator) at Effective Altruism Global X Boston
• Talk and panel at the Governance of Emerging Technologies conference at ASU
• Talk and panel at Brain Bar Budapest
• AI safety session at OpenAI unconference
• Talk and panel at Effective Altruism Global X Oxford
• Talk and panel at Cambridge Catastrophic Risk Conference run by CSER

Using humility to counteract shame

“Pride is not the opposite of shame, but its source. True humility is the only antidote to shame.”

Uncle Iroh, “Avatar: The Last Airbender”

 

Shame is one of the trickiest emotions to deal with. It is difficult to think about, not to mention discuss with others, and gives rise to insidious ugh fields and negative spirals. Shame often underlies other negative emotions without making itself apparent – anxiety or anger at yourself can be caused by unacknowledged shame about the possibility of failure. It can stack on top of other emotions – e.g. you start out feeling upset with someone, and end up being ashamed of yourself for feeling upset, and maybe even ashamed of feeling ashamed if meta-shame is your cup of tea. The most useful approach I have found against shame is invoking humility.

2015-16 New Year review

2015 progress

Research:

• Finished paper on the Selective Bayesian Forest Classifier algorithm
• Made an R package for SBFC (beta)
• Worked at Google on unsupervised learning for the Knowledge Graph with Moshe Looks during the summer (paper)
• Joined the HIPS research group at Harvard CS and started working with the awesome Finale Doshi-Velez
• Ratio of coding time to writing time was too high overall

FLI:

• Co-organized two meetings to brainstorm biotechnology risks
• Co-organized two Machine Learning Safety meetings
• Gave a talk at the Shaping Humanity’s Trajectory workshop at EA Global
• Helped organize NIPS symposium on societal impacts of AI

Rationality / effectiveness:

• Extensive use of FollowUpThen for sending reminders to future selves
• Mapped out my personal bottlenecks
• Sleep:
  • Tracked insomnia (26% of nights) and sleep time (average 1:30am, stayed up past 1am on 31% of nights)
  • Started working on sleep hygiene
  • Stopped using melatonin (found it ineffective)

Systems I have tried: an overview

I have used various organization and productivity systems in the past few years – this is an overview of what worked and what didn’t.

Main systems I currently use:

1. Follow Up Then: Sends an email to a future self, with the date and time specified in the email address, e.g. fri6pm@fut.io. I use it for delaying tasks, recurring reminders, and following up on email threads. This reduces clutter in my todo list, calendar and inbox, and frees my working memory. Lately, I noticed myself remembering a thing shortly before receiving a follow up about it – probably due to the same mechanism that sometimes wakes me up a few minutes before the morning alarm.
2. Complice: Daily to-do list organized according to goals, with archives and regular reviews. Helpful for specifying the next action to take at a given time, and for tracking progress on individual goals. Downside: I sometimes hesitate to enter tasks into the list, because entered tasks cannot be erased, and leaving a task unfinished is aversive, so often end up entering tasks after they are done instead.
3. Workflowy: Nested list structure – searchable, with collapsible and sharable sublists. I keep my ongoing todo list (in GTD form) and most of my notes here. Downside: doesn’t work for goal factoring, since it only supports tree structures.
4. Google Calendar: Self-explanatory. I have recently started adding tentative meeting slots, indicated by a question mark, e.g. “dinner with Janos?”. This has been helpful for keeping track of which time slots I’ve offered to someone. I also added a calendar that shows Facebook events that I’ve been invited to, which is handy.
5. 42 Goals: Goal tracking with summary graphs and cute symbols. I use this for tracking habits (like exercise and meditation) and other random things (like insomnia occurrences). The graphs are useful – this is how I know that I have the most insomnia on Mondays! Downsides: doesn’t allow non-binary categories, and the phone app is so unreliable that I never use it – if you know good alternative tracking systems, let me know!