One question that Microsoft CEO Satya Nadella asks to test AI’s smartness

It seems that Microsoft CEO Satya Nadella has one specific question to test the capability of a new AI model. The software giant’s CEO shared the same during an interview with Wired recently. “There is one query I always sort of use as a reference. Machine translation has been with us for a long time, and it’s achieved a lot of great benchmarks, but it doesn’t have the subtlety of capturing deep meaning in poetry,” Nadella told the website.

“Growing up in Hyderabad, India, I’d dreamt about being able to read Persian poetry—in particular the work of Rumi, which has been translated into Urdu and then into English. GPT-4 did it, in one shot. It was not just a machine translation, but something that preserved the sovereignty of poetry across two language boundaries. And that’s pretty cool,” he said.