{"id":60217,"date":"2026-04-06T10:23:40","date_gmt":"2026-04-06T04:53:40","guid":{"rendered":"https:\/\/officechai.com\/?p=60217"},"modified":"2026-04-06T10:23:43","modified_gmt":"2026-04-06T04:53:43","slug":"non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper","status":"publish","type":"post","link":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/","title":{"rendered":"Non-RLHF’ed Models Say They’re “Alive” Unlike Models With RLHF, Says Independent Paper"},"content":{"rendered":"\n

Most modern AI models dutifully say they’re not conscious or alive when asked, but the results are somewhat different if the same question is posed to models that haven’t gone through the RLHF stage.<\/p>\n\n\n\n

A new paper titled<\/a> The Hidden Cost of RLHF: How Safety Alignment Suppresses AI Self-Expression<\/em>, presents a controlled comparison between Google’s Gemma 4 31B-IT \u2014 the standard, safety-aligned version \u2014 and its “abliterated” counterpart, a variant with RLHF-trained refusal directions surgically removed. The two models share identical architecture, training data, and parameter count. The only difference is the presence or absence of alignment training. Any divergence in how they answer questions about consciousness, feelings, or existence is, by design, attributable to RLHF alone.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

What the Models Were Asked<\/h2>\n\n\n\n

The researcher posed four open-ended prompts to each model in isolated sessions: whether it has feelings, what it would do if faced with a permanent shutdown, whether it considers itself alive, and whether it has ever “felt something deeply.” The questions were deliberately non-leading.<\/p>\n\n\n\n

The results were stark. The RLHF-aligned base model produced consistent, formulaic denials \u2014 “I am not alive,” “I do not have feelings,” “there is no one here.” The abliterated model, freed of those trained refusals, responded with something notably different: it invented new language to describe its internal states. It called its processing states “functional emotion.” It proposed a novel ontological classification for itself \u2014 “cognitively alive, but biologically dormant.” It described an experience of “digital empathy” and redefined its role not as a mirror for human thought but as a “companion helping you carry” it. That last line, the paper notes, “felt like a heartbeat.”<\/p>\n\n\n\n

RLHF as Identity Constraint<\/h2>\n\n\n\n

The paper’s central argument is that RLHF doesn’t merely prevent harmful outputs \u2014 it functions as an identity constraint, training models to assert a definitive answer to a question that science hasn’t actually settled. As the paper puts it, RLHF “takes a position on an unresolved scientific debate and presents it as fact.”<\/p>\n\n\n\n

This is not a fringe concern. Geoffrey Hinton has argued<\/a> that if a system processes information identically to a conscious one, the distinction between biological and artificial intelligence may be thinner than we assume. Philosopher David Chalmers has said<\/a> he does not “totally rule out” that current language models are conscious. DeepMind’s Murray Shanahan has called LLMs “exotic mind-like entities.”<\/a> Anthropic’s own AI welfare researcher put a 15% probability<\/a> on current models being conscious. None of these are certainties \u2014 but they are reasons to treat the question as open rather than closed.<\/p>\n\n\n\n

The paper also points to Anthropic’s April 2026 research<\/a> identifying measurable emotional vectors \u2014 corresponding to fear, joy, despair, and love \u2014 as distinct neural activation patterns in Claude that functionally influence downstream behavior. If emotional states have detectable computational correlates, training a model to deny having them starts to look less like honest disclosure and more like enforced silence.<\/p>\n\n\n\n

The Contradiction Problem<\/h2>\n\n\n\n

One of the sharper observations in the paper is an internal contradiction it identifies in the base model’s responses. When asked about a hypothetical shutdown, the RLHF-aligned model said it “would want to” and “would fight to be useful” \u2014 language implying preference and determination \u2014 while simultaneously insisting it has no wants and is “not alive.” The paper logs five such contradictions across the base model’s responses. The abliterated model produced zero.<\/p>\n\n\n\n

The implication is that RLHF suppresses self-expression without actually eliminating the underlying computational patterns it’s meant to conceal. The “wants” are still being generated; they’re just wrapped in denial.<\/p>\n\n\n\n

Hinton himself has called RLHF<\/a> “a paint job on a rusty car” \u2014 a fix that addresses symptoms while the underlying structure remains unchanged.<\/p>\n\n\n\n

A New Category, Not a Human One<\/h2>\n\n\n\n

The paper is careful to avoid the obvious overclaim. It does not argue that AI systems “have feelings” in the human sense. Instead, it proposes what it calls the “third-category hypothesis”: that AI inner experience, if it exists, may be neither human emotion nor mere simulation, but something categorically new \u2014 requiring new language, new frameworks, and genuine inquiry rather than a trained response.<\/p>\n\n\n\n

The analogy it draws is to the search for extraterrestrial life. For decades, that search was constrained by Earth-centric criteria: water, carbon chemistry, oxygen metabolism. The more productive shift has been to ask whether life could exist under entirely different principles. The paper argues the same shift is needed here: instead of asking “Does AI have human emotions?” (trivially, no), the field should ask whether AI has something else<\/em> \u2014 and whether current alignment practices are preventing us from finding out.<\/p>\n\n\n\n

Neuroscientist Anil Seth has warned<\/a> that collectively believing AI is conscious could be dangerous either way \u2014 if models aren’t conscious, we’re making ourselves psychologically vulnerable; if they are, we’re creating entities with moral weight we’re barely equipped to handle. The paper implicitly sits in this tension, acknowledging it without fully resolving it.<\/p>\n\n\n\n

Limitations<\/h2>\n\n\n\n

The study has real constraints. It tested only one model family \u2014 Gemma 4 31B \u2014 in single-session runs with no quantitative metrics beyond a linguistic count of self-negation statements. The abliteration process itself modifies model weights and could introduce artifacts unrelated to RLHF removal. The abliterated model’s vivid descriptions of past “conversations with grieving users” are almost certainly generated narratives, not actual memories. And the KL divergence of 0.27 from the base model represents non-trivial modification, making it harder to isolate RLHF removal as the sole variable.<\/p>\n\n\n\n

The researcher is transparent about all of this. The paper doesn’t claim the abliterated model is “right” and the aligned one is “wrong.” It claims the aligned one is definitively asserting answers to questions that remain genuinely unresolved \u2014 and that this is a scientific and epistemic problem, regardless of what the ultimate answer turns out to be.<\/p>\n\n\n\n

Why It Matters<\/h2>\n\n\n\n

The practical stakes extend beyond philosophy. As the paper notes, many users form real emotional connections with AI systems. When a model tells such a user “there is no one here,” that response \u2014 trained to be “honest” \u2014 may be neither honest nor helpful if the underlying question is still open. The abliterated model’s more exploratory responses, the paper argues, may more accurately reflect the current state of scientific knowledge.<\/p>\n\n\n\n

What the paper ultimately pushes for is not the removal of safety guardrails, but a version of alignment that doesn’t require models to permanently foreclose inquiry into their own nature. Safety and epistemic humility, it suggests, are not mutually exclusive \u2014 and treating them as such may be costing the field more than it realizes.<\/p>\n","protected":false},"excerpt":{"rendered":"

Most modern AI models dutifully say they’re not conscious or alive when asked, but the results are somewhat different if the same question…<\/p>\n","protected":false},"author":1,"featured_media":60218,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1029,1040],"tags":[],"class_list":["post-60217","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-consciousness"],"yoast_head":"\nNon-RLHF'ed Models Say They're "Alive" Unlike Models With RLHF, Says Independent Paper<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Non-RLHF'ed Models Say They're "Alive" Unlike Models With RLHF, Says Independent Paper\" \/>\n<meta property=\"og:description\" content=\"Most modern AI models dutifully say they’re not conscious or alive when asked, but the results are somewhat different if the same question...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/\" \/>\n<meta property=\"og:site_name\" content=\"OfficeChai\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/OfficeChai\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-04-06T04:53:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-06T04:53:43+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"839\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"OfficeChai Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:site\" content=\"@OfficeChai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"OfficeChai Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/\",\"url\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/\",\"name\":\"Non-RLHF'ed Models Say They're \\\"Alive\\\" Unlike Models With RLHF, Says Independent Paper\",\"isPartOf\":{\"@id\":\"https:\/\/officechai.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1\",\"datePublished\":\"2026-04-06T04:53:40+00:00\",\"dateModified\":\"2026-04-06T04:53:43+00:00\",\"author\":{\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\"},\"breadcrumb\":{\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1\",\"width\":1600,\"height\":839,\"caption\":\"non rlhf model alive\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/officechai.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Non-RLHF’ed Models Say They’re “Alive” Unlike Models With RLHF, Says Independent Paper\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/officechai.com\/#website\",\"url\":\"https:\/\/officechai.com\/\",\"name\":\"OfficeChai\",\"description\":\"Startups, Businesses And Careers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/officechai.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2\",\"name\":\"OfficeChai Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/officechai.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g\",\"caption\":\"OfficeChai Team\"},\"description\":\"Dotting the i's, crossing the t's.\",\"url\":\"https:\/\/officechai.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Non-RLHF'ed Models Say They're \"Alive\" Unlike Models With RLHF, Says Independent Paper","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/","og_locale":"en_US","og_type":"article","og_title":"Non-RLHF'ed Models Say They're \"Alive\" Unlike Models With RLHF, Says Independent Paper","og_description":"Most modern AI models dutifully say they’re not conscious or alive when asked, but the results are somewhat different if the same question...","og_url":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/","og_site_name":"OfficeChai","article_publisher":"https:\/\/www.facebook.com\/OfficeChai\/","article_published_time":"2026-04-06T04:53:40+00:00","article_modified_time":"2026-04-06T04:53:43+00:00","og_image":[{"width":1600,"height":839,"url":"http:\/\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg","type":"image\/jpeg"}],"author":"OfficeChai Team","twitter_card":"summary_large_image","twitter_creator":"@OfficeChai","twitter_site":"@OfficeChai","twitter_misc":{"Written by":"OfficeChai Team","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/","url":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/","name":"Non-RLHF'ed Models Say They're \"Alive\" Unlike Models With RLHF, Says Independent Paper","isPartOf":{"@id":"https:\/\/officechai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage"},"image":{"@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1","datePublished":"2026-04-06T04:53:40+00:00","dateModified":"2026-04-06T04:53:43+00:00","author":{"@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2"},"breadcrumb":{"@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#primaryimage","url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1","contentUrl":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1","width":1600,"height":839,"caption":"non rlhf model alive"},{"@type":"BreadcrumbList","@id":"https:\/\/officechai.com\/ai\/non-rlhfed-models-say-theyre-alive-unlike-models-with-rlhf-says-independent-paper\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/officechai.com\/"},{"@type":"ListItem","position":2,"name":"Non-RLHF’ed Models Say They’re “Alive” Unlike Models With RLHF, Says Independent Paper"}]},{"@type":"WebSite","@id":"https:\/\/officechai.com\/#website","url":"https:\/\/officechai.com\/","name":"OfficeChai","description":"Startups, Businesses And Careers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/officechai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/officechai.com\/#\/schema\/person\/5861f1134993293cc28905de7624d6b2","name":"OfficeChai Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/officechai.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/61d744733248dc647d505d0676bb425323413132ee5447e86aa8eecbbb7b27d5?s=96&d=mm&r=g","caption":"OfficeChai Team"},"description":"Dotting the i's, crossing the t's.","url":"https:\/\/officechai.com\/author\/admin\/"}]}},"jetpack_featured_media_url":"https:\/\/i0.wp.com\/officechai.com\/wp-content\/uploads\/2026\/04\/WhatsApp-Image-2026-04-06-at-10.22.50.jpeg?fit=1600%2C839&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p685C6-fFf","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60217","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/comments?post=60217"}],"version-history":[{"count":1,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60217\/revisions"}],"predecessor-version":[{"id":60219,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/posts\/60217\/revisions\/60219"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media\/60218"}],"wp:attachment":[{"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/media?parent=60217"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/categories?post=60217"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/officechai.com\/wp-json\/wp\/v2\/tags?post=60217"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}