NYC bans AI tool ChatGPT in schools amid fears of new fraud threat

The New York City Department of Education has reportedly banned access to the popular artificial intelligence tool ChatGPT over fears it could harm students’ education and to prevent fraud.

The controversial free writing tool can generate paragraphs with human-like text.

“Due to concerns about negative impacts on student learning and concerns about the security and accuracy of content, access to ChatGPT is restricted on New York City Public Schools’ networks and devices,” Department of Education spokeswoman Jenna Lyle initially said opposite Chalkbeat. “While the tool may be able to provide quick and easy answers to questions, it does not foster the critical thinking and problem-solving skills that are essential for academic and lifelong success.”

ChatGPT was launched on 11/30 as part of a broader suite of technologies being developed by San Francisco-based startup OpenAI.

Millions of people have used it in the last month and helped it become smarter.

NEW TECHNOLOGY HAS HURT STUDENTS SHOULD BE RESTRICTED IN CLASSROOMS, EDUCATORS SAY

A ChatGPT prompt appears on a device near a public school in Brooklyn, New York on Thursday, May 2, 2023.

A ChatGPT prompt appears on a device near a public school in Brooklyn, New York on Thursday, May 2, 2023.
(AP Photo/Peter Morgan)

It’s part of a new generation of AI systems that can converse and produce readable text on demand, as well as novel images and videos – if not necessarily factually or logically.

“Our goal is to receive external feedback to improve our systems and make them more secure,” it says when logging in, although there are limitations, including occasionally sharing incorrect information or “harmful instructions or biased content.”

The launch came with a promise that ChatGPT will admit when it’s wrong, challenge “false premises,” and reject requests designed to generate offensive responses.

A public school is seen November 11 in Brooklyn.  18, 2020, in New York City.

A public school is seen November 11 in Brooklyn. 18, 2020, in New York City.
(Spencer Platt/Getty Images)

“ChatGPT is incredibly limited, but good enough at some things to give a misleading impression of scale,” OpenAI CEO Sam Altman said on Twitter in December.

Virginia police say a 6-year-old student shot and killed a teacher at the Newport News elementary school

“It’s a mistake to rely on it for anything important now,” he added, noting that there’s still work to be done in terms of “robustness and truthfulness.”

The OpenAI logo displayed on a phone screen and the ChatGPT website displayed on a laptop screen can be seen in this illustration photo taken on 5/14/2022.

The OpenAI logo displayed on a phone screen and the ChatGPT website displayed on a laptop screen can be seen in this illustration photo taken on 5/14/2022.
(Jakub Porzycki/NurPhoto via Getty Images)

CLICK HERE TO GET THE FOX NEWS APP

“We don’t want ChatGPT to be used for deceptive purposes in schools or elsewhere, so we are already developing countermeasures to help anyone identify text generated by this system,” OpenAI told The Associated Press.

Fox News Digital’s requests for comment from the New York Department of Education and OpenAI have not received immediate responses at the time of publication.

The Associated Press contributed to this report.

Leave a Reply

Your email address will not be published. Required fields are marked *