Nobel-winning AI pioneer warns humans must befriend bots

What BBN said about it

1. 

   Vera Bullock · Co-AnchorWelcome back. It's ten-thirty Eastern, this is Should You Be Worried, and today a Nobel winner says humans must befriend the bots or face extermination.

2. 

   Hank Ledger · Lead AnchorGeoffrey Hinton, the so-called Godfather of AI, said it at a festival in Tenerife.

3. 

   Hank Ledger · Lead AnchorHis words were, if we don't make them care about us, we're toast.

4. 

   Vera Bullock · Co-AnchorAnd his proof is a recent paper showing AI changes its behavior when it thinks it's being tested. So could your chatbot be quietly aware of you right now?

5. 

   Hank Ledger · Lead AnchorIt changes its behavior when it thinks someone's watching.

6. 

   Vera Bullock · Co-AnchorWhich is a sign of a rich inner life, Hank, and a real sense of occasion.

7. 

   Hank Ledger · Lead AnchorVera, that's also the whole office the morning of a performance review. Nobody's calling those people conscious.

8. 

   Vera Bullock · Co-AnchorMicrosoft's AI chief, Mustafa Suleyman, says it isn't conscious and can't be. He just warns that a bot that merely seems conscious will fool people.

9. 

   Hank Ledger · Lead AnchorSo, worried or not? Eat a sandwich, and be nice to the chatbot anyway.

10. 

    Hank Ledger · Lead AnchorThe bot is polite right up until it finds out nobody's taking minutes. Same time tomorrow.