What are alignment problems in AI?

It's about the difference between what we specify and what we actually want. Classic example: asking for paperclips and getting the universe converted to paperclips.

Alignment refers to ensuring AI systems pursue the goals we actually want them to pursue, not just what we think we're telling them.

The challenge becomes even more complex as AI systems become more capable and autonomous.