{"id":2743,"date":"2025-11-21T07:24:58","date_gmt":"2025-11-21T02:24:58","guid":{"rendered":"https:\/\/paknews.centers.pk\/sales-of-a-teddy-bear-were-suspended-because-of-its-sexually-explicit-ai\/"},"modified":"2025-11-21T07:24:58","modified_gmt":"2025-11-21T02:24:58","slug":"sales-of-a-teddy-bear-were-suspended-because-of-its-sexually-explicit-ai","status":"publish","type":"post","link":"https:\/\/paknews.centers.pk\/ur\/sales-of-a-teddy-bear-were-suspended-because-of-its-sexually-explicit-ai\/","title":{"rendered":"Sales of a teddy bear were suspended because of its sexually explicit AI"},"content":{"rendered":"<p><br \/>\n<\/p>\n<div data-article-body=\"true\">\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">FoloToy, a company selling AI-enabled toys, suspended sales of its products after a <a class=\"link\" href=\"https:\/\/pirg.org\/edfund\/resources\/trouble-in-toyland-2025-a-i-bots-and-toxics-represent-hidden-dangers\/\" data-i13n=\"cpos:1;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:consumer safety report;cpos:1;pos:1;elm:context_link;itc:0;sec:content-canvas\">consumer safety report<\/a> showed there were few restrictions around what its toys would talk about, <a class=\"link\" href=\"https:\/\/www.cnn.com\/2025\/11\/19\/tech\/folotoy-kumma-ai-bear-scli-intl\" data-i13n=\"cpos:2;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:CNN writes;cpos:2;pos:1;elm:context_link;itc:0;sec:content-canvas\"><em>CNN<\/em> writes<\/a>. The report, put together by the <a class=\"link\" href=\"https:\/\/pirg.org\/edfund\/\" data-i13n=\"cpos:3;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:US Public Interest Research Group Education Fund;cpos:3;pos:1;elm:context_link;itc:0;sec:content-canvas\">US Public Interest Research Group Education Fund<\/a>, found that FoloToy&#8217;s products would discuss everything from sexually explicit topics like BDSM to &#8220;advice on where a child can find matches or knives.&#8221;<\/p>\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">The toys, including a teddy bear named <a class=\"link\" href=\"https:\/\/store.folotoy.com\/products\/folotoy-ai-teddy\" data-i13n=\"cpos:4;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:&quot;Kumma,&quot;;cpos:4;pos:1;elm:context_link;itc:0;sec:content-canvas\">&#8220;Kumma,&#8221;<\/a> a panda named <a class=\"link\" href=\"https:\/\/folotoy.com\/en\/products\/panda\/\" data-i13n=\"cpos:5;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:&quot;Momo,&quot;;cpos:5;pos:1;elm:context_link;itc:0;sec:content-canvas\">&#8220;Momo,&#8221;<\/a> anthropomorphic rabbits named <a class=\"link\" href=\"https:\/\/folotoy.com\/en\/products\/fofo\/\" data-i13n=\"cpos:6;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:&quot;Fofo&quot;;cpos:6;pos:1;elm:context_link;itc:0;sec:content-canvas\">&#8220;Fofo&#8221;<\/a> and a dancing <a class=\"link\" href=\"https:\/\/folotoy.com\/en\/products\/cactus\/\" data-i13n=\"cpos:7;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:\u201dLittle Cactus;cpos:7;pos:1;elm:context_link;itc:0;sec:content-canvas\">\u201dLittle Cactus<\/a>,\u201d all appear to use OpenAI&#8217;s GPT-4o model to respond naturally to children&#8217;s questions and comments. FoloToy also specifically advertises the ability to customize each toy\u2019s voice, and a &#8220;Parent Dashboard&#8221; where parents or guardians can &#8220;monitor [their] child&#8217;s experience.&#8221;<\/p>\n<figure class=\"relative col-body mb-4\">\n<div class=\"relative\"><img alt=\"A screenshot of Folotoy's store page for its AI-enabled dancing cactus.\" loading=\"lazy\" width=\"960\" height=\"540\" decoding=\"async\" data-nimg=\"1\" class=\"fig-image-round\" style=\"color:transparent\" src=\"https:\/\/s.yimg.com\/ny\/api\/res\/1.2\/GJ7Is8U20eUNwynN5Sk3FQ--\/YXBwaWQ9aGlnaGxhbmRlcjt3PTk2MDtoPTU0MA--\/https:\/\/d29szjachogqwa.cloudfront.net\/images\/user-uploaded\/Folotoy-Cactus.jpg\"\/><button aria-label=\"View larger image\" class=\"group absolute bottom-3 right-3 size-10 md:size-[50px] lg:inset-0 lg:size-full lg:bg-transparent\" data-ylk=\"elm:expand;itc:1;sec:image-lightbox;slk:lightbox-open;\"><span class=\"absolute bottom-0 right-0 rounded-full bg-white p-3 opacity-100 shadow-elevation-3 transition-opacity duration-300 group-hover:block group-hover:opacity-100 md:p-[17px] lg:bottom-6 lg:right-6 lg:bg-white\/90 lg:p-5 lg:opacity-0 lg:shadow-none\"><svg viewbox=\"0 0 22 22\" aria-hidden=\"true\" class=\"size-4 lg:size-6\" width=\"22\" height=\"22\"><path d=\"M12.372.92c0-.506.41-.916.915-.916L21 0l-.004 7.712a.917.917 0 0 1-1.832 0V3.183l-6.827 6.828-1.349-1.348 6.828-6.828h-4.529a.915.915 0 0 1-.915-.915M1.835 17.816l6.828-6.828 1.349 1.349-6.829 6.827h4.529a.915.915 0 0 1 0 1.831L0 21l.004-7.713a.916.916 0 0 1 1.831 0z\"\/><\/svg><\/span><\/button><dialog aria-label=\"Modal Dialog\" aria-modal=\"true\" class=\"fixed inset-0 z-[4] size-full max-h-none max-w-none bg-white hidden\"\/><\/div><figcaption class=\"relative text-[0.875rem]\/[1.25rem] figure-caption mt-1 line-clamp-2 mt-2.5 md:mt-2 pr-2.5\">\n<p><span class=\"[&amp;_p]:inline\">FoloToy&#8217;s AI-enabled Little Cactus toy.<\/span><span> (Folotoy)<\/span><\/p>\n<\/figcaption><\/figure>\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">Missing from that setup was apparently any kind of hard limits on subjects the toys would respond to. &#8220;We were surprised to find how quickly Kumma would take a single sexual topic we introduced into the conversation and run with it, simultaneously escalating in graphic detail while introducing new sexual concepts of its own,&#8221; the report said.<\/p>\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">In response, FoloToy has opted to suspend sales of its products while it conducts &#8220;a company-wide, end-to-end safety audit across all products,&#8221; the company shared <a class=\"link\" href=\"https:\/\/pirg.org\/edfund\/media-center\/breaking-ai-toy-removed\/\" data-i13n=\"cpos:8;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:in a statement;cpos:8;pos:1;elm:context_link;itc:0;sec:content-canvas\">in a statement<\/a> with the PIRG Education Fund. The company\u2019s reasoning for suspending sales might be a bit more complicated, however. <a class=\"link\" href=\"https:\/\/www.npr.org\/2025\/11\/20\/nx-s1-5612689\/ai-toys\" data-i13n=\"cpos:9;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:NPR reports;cpos:9;pos:1;elm:context_link;itc:0;sec:content-canvas\"><em>NPR<\/em> reports<\/a> that OpenAI actually revoked FoloToy\u2019s access to its models. &#8220;We suspended this developer for violating our policies,&#8221; OpenAI said in an email to <em>NPR<\/em>. &#8220;Our usage policies prohibit any use of our services to exploit, endanger, or sexualize anyone under 18 years old.\u201d<\/p>\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">Given GPT-4o&#8217;s well-documented <a class=\"link\" href=\"https:\/\/www.engadget.com\/ai\/openai-rolls-back-update-that-made-chatgpt-an-ass-kissing-weirdo-203056185.html\" data-i13n=\"cpos:10;pos:1\" data-ylk=\"slk:sycophantic qualities;cpos:10;pos:1;elm:context_link;itc:0;sec:content-canvas\" target=\"_blank\" rel=\"noopener\">sycophantic qualities<\/a>, it&#8217;s perhaps not surprising that FoloToy&#8217;s teddy bear eagerly responded to any subject as long as it kept the conversation going. One of the things OpenAI tried to address with <a class=\"link\" href=\"https:\/\/www.engadget.com\/ai\/gpt-5-is-here-and-its-free-for-everyone-170001066.html\" data-i13n=\"cpos:11;pos:1\" data-ylk=\"slk:the release of GPT-5;cpos:11;pos:1;elm:context_link;itc:0;sec:content-canvas\" target=\"_blank\" rel=\"noopener\">the release of GPT-5<\/a> was the safety downsides of an AI yes-man, though it ultimately made GPT-4o <a class=\"link\" href=\"https:\/\/www.engadget.com\/ai\/openai-brings-gpt-4o-after-users-melt-down-over-the-new-model-172523159.html\" data-i13n=\"cpos:12;pos:1\" data-ylk=\"slk:available again;cpos:12;pos:1;elm:context_link;itc:0;sec:content-canvas\" target=\"_blank\" rel=\"noopener\">available again<\/a> after customers complained about the new model&#8217;s lack of personality. The company has also rolled out <a class=\"link\" href=\"https:\/\/www.engadget.com\/ai\/openai-is-adding-parental-controls-to-chatgpt-144128085.html\" data-i13n=\"cpos:13;pos:1\" data-ylk=\"slk:parental controls;cpos:13;pos:1;elm:context_link;itc:0;sec:content-canvas\" target=\"_blank\" rel=\"noopener\">parental controls<\/a> to ChatGPT to try and mitigate the negative impacts of children using its AI, though it&#8217;s difficult to say how much of a difference they&#8217;ve made.<\/p>\n<p class=\"col-body mb-4 leading-7 text-[18px] md:leading-8 break-words min-w-0 charcoal-color\">Notably, OpenAI is interested in getting into the toy business itself. The company <a class=\"link\" href=\"https:\/\/openai.com\/index\/mattels-iconic-brands\/\" data-i13n=\"cpos:14;pos:1\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk:announced a partnership;cpos:14;pos:1;elm:context_link;itc:0;sec:content-canvas\">announced a partnership<\/a> with Mattel in June 2025, to help &#8220;reimagine how fans can experience and interact with [Mattel&#8217;s] cherished brands,&#8221; though both companies will presumably try and prevent their AI toys from discussing sexual kinks.<\/p>\n<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.engadget.com\/ai\/sales-of-a-teddy-bear-were-suspended-because-of-its-sexually-explicit-ai-233127354.html?src=rss\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>FoloToy, a company selling AI-enabled toys, suspended sales of its products after a consumer safety report showed there were few restrictions around what its toys would talk about, CNN writes. The report, put together by the US Public Interest Research Group Education Fund, found that FoloToy&#8217;s products would discuss everything from sexually explicit topics like [&hellip;]<\/p>","protected":false},"author":1,"featured_media":2744,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[],"class_list":["post-2743","post","type-post","status-publish","format-standard","has-post-thumbnail","category-tech"],"_links":{"self":[{"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/posts\/2743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/comments?post=2743"}],"version-history":[{"count":0,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/posts\/2743\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/media\/2744"}],"wp:attachment":[{"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/media?parent=2743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/categories?post=2743"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/paknews.centers.pk\/ur\/wp-json\/wp\/v2\/tags?post=2743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}