Do you need a PhD to work on AI Safety?

No, but it helps. Some great resources if you're considering it, are:

The first two links show general ways to get into AI safety, and the last will show you the upsides and downsides of choosing to make a PhD.