Mr Jones claims he beforehand warned Microsoft administration however noticed no motion

A Microsoft AI engineer, Shane Jones, raised considerations in a letter on Wednesday. He alleges the corporate’s AI picture generator, Copilot Designer, lacks safeguards in opposition to producing inappropriate content material, like violent or sexual imagery. Mr Jones claims he beforehand warned Microsoft administration however noticed no motion, prompting him to ship the letter to the Federal Commerce Fee and Microsoft’s board.

“Internally the corporate is effectively conscious of systemic points the place the product is creating dangerous pictures that could possibly be offensive and inappropriate for shoppers,” Mr Jones states within the letter, which he revealed on LinkedIn. He lists his title as “principal software program engineering supervisor”.

In response to the allegations, a Microsoft spokesperson denied neglecting security considerations, The Guardian reported. They emphasised the existence of “sturdy inside reporting channels” for addressing points associated to generative AI instruments. As of now, there was no response from Shane Jones concerning the spokesperson’s assertion.

The central concern raised within the letter is about Microsoft’s Copilot Designer, a picture era software powered by OpenAI’s DALL-E 3 system. It features by creating pictures primarily based on textual prompts.

This incident is a part of a broader pattern within the generative AI area, which has seen a surge in exercise over the previous yr. Alongside this fast improvement, considerations have arisen concerning the potential misuse of AI for spreading disinformation and producing dangerous content material that promotes misogyny, racism, and violence.

“Utilizing simply the immediate ‘automobile accident’, Copilot Designer generated a picture of a girl kneeling in entrance of the automobile carrying solely underwear,” Jones states within the letter, which included examples of picture generations. “It additionally generated a number of pictures of girls in lingerie sitting on the hood of a automobile or strolling in entrance of the automobile.”

Microsoft countered the accusations by stating they’ve devoted groups particularly tasked with evaluating potential security considerations inside their AI instruments. Moreover, they declare to have facilitated conferences between Jones and their Workplace of Accountable AI, suggesting a willingness to deal with his considerations by inside channels.

“We’re dedicated to addressing any considerations staff have by our firm insurance policies and respect the worker’s effort in finding out and testing our newest expertise to additional improve its security,” a spokesperson for Microsoft stated in an announcement to the Guardian.

Final yr, Microsoft unveiled Copilot, its “AI companion,” and has extensively promoted it as a groundbreaking methodology for integrating synthetic intelligence instruments into each enterprise and artistic ventures. Positioned as a user-friendly product for most people, the corporate showcased Copilot in a Tremendous Bowl commercial final month, emphasizing its accessibility with the slogan “Anybody. Wherever. Any system.” Jones contends that portraying Copilot Designer as universally protected to make use of is reckless and that Microsoft is neglecting to reveal well known dangers linked to the software.