What are alignment problems in AI?

Alignment refers to ensuring AI systems pursue the goals we actually want them to pursue, not just what we think we're telling them.

It's about the difference between what we specify and what we actually want. Classic example: asking for paperclips and getting the universe converted to paperclips.

The challenge becomes even more complex as AI systems become more capable and autonomous.