{"id":25330,"date":"2025-05-12T17:10:51","date_gmt":"2025-05-12T15:10:51","guid":{"rendered":"https:\/\/comunicagenia.com\/blog\/reasoning-models-in-ai-are-they-approaching-a-limit\/"},"modified":"2025-05-12T17:10:51","modified_gmt":"2025-05-12T15:10:51","slug":"reasoning-models-in-ai-are-they-approaching-a-limit","status":"publish","type":"post","link":"https:\/\/comunicagenia.com\/en\/blog\/reasoning-models-in-ai-are-they-approaching-a-limit\/","title":{"rendered":"Reasoning models in AI: Are they approaching a limit?"},"content":{"rendered":"<p><span style=\"font-weight: 400\">Imagine a world where machines not only calculate, but also reason in a way analogous to a human being: solving complex equations, proving theorems or generating flawless code instantly.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Today,<\/span><b> this dream is a reality thanks to AI reasoning models<\/b><span style=\"font-weight: 400\">, which have established themselves as essential tools in fields as diverse as mathematical research or advanced programming.<\/span><\/p>\n<p><span style=\"font-weight: 400\">However, a recent report from Epoch AI, a non-profit organization dedicated to researching trends in artificial intelligence (AI), warns that <\/span><b>the exponential pace of progress could stall sooner than expected<\/b><span style=\"font-weight: 400\">.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">While some experts envision a next computational and economic \u201cceiling,\u201d others, like Sam Altman of OpenAI, continue to bet on new innovations. Are we on the verge of a slowdown or are we simply facing a temporary blip?<\/span><\/p>\n<p><span style=\"font-weight: 400\">Keep reading and <\/span><b>discover what could stop these advances<\/b><span style=\"font-weight: 400\">, the promises that still maintain optimism and the avenues of research that aim to overcome current barriers.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">Why might progress be slowed?<\/span><\/h2>\n<p><span style=\"font-weight: 400\">Epoch AI maintains that the escalation in resources needed to train reasoning models is reaching unsustainable levels.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">For example, <\/span><b>to move from model o1 to o3, OpenAI invested approximately ten times more computing power<\/b><span style=\"font-weight: 400\">, concentrated in refinement phases through reinforcement learning.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">If this trajectory continues, it is estimated that the development of the following generations could exceed 1 billion euros in 2027, a figure that puts the margins of any research laboratory in check.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Infrastructure limits<\/span><\/h3>\n<p><span style=\"font-weight: 400\">The production of semiconductors and the availability of electrical energy are two critical bottlenecks. <\/span><b>Data centers already consume a high percentage of global energy<\/b><span style=\"font-weight: 400\">, and the manufacturing of <\/span><a href=\"https:\/\/comunicagenia.com\/blog\/chips-for-artificial-intelligence-the-silent-engine-of-the-revolution\/?lang=en\"><span style=\"font-weight: 400\">advanced chips<\/span><\/a><span style=\"font-weight: 400\"> faces supply constraints and rising costs.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">According to Epoch AI, up to 2\u00b710\u00b2\u2079 FLOP would be needed to achieve the 2030 goals, a magnitude that far exceeds the current installed capacity today.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Diminishing returns<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Traditional \u201cscaling laws\u201d indicate that each increase in power or parameters produces improvements in performance that follow a curve of diminishing returns.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">That is, as the model and the computation grow, the gain per extra unit of resource decreases, <\/span><b>making each advance more costly and less profitable.<\/b><\/p>\n<p><span style=\"font-weight: 400\">Reasoning models have relied on scaling both size and computation (and also inference time) to break records in specialized benchmarks. Epoch AI and other analyzes project that it will soon no longer pay to scale just by adding computing power.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">What do reasoning models promise us?<\/span><\/h2>\n<p><span style=\"font-weight: 400\">In the previous part we talked about <\/span><b>why<\/b><span style=\"font-weight: 400\"> we could reach a brake (costs, infrastructure, diminishing returns). So it&#8217;s time to remember why we invest so much in these models.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Solutions to complex problems<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Despite the shadows, the progress has been surprising. Models like o3 or DeepSeek-R1 can:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><b>Prove mathematical theorems <\/b><span style=\"font-weight: 400\">of moderate complexity in minutes, a task that previously required weeks of human work.<\/span><\/li>\n<li style=\"font-weight: 400\"><b>Generate code<\/b><span style=\"font-weight: 400\"> with a level of correctness that is close to 90% on platforms such as LeetCode or GitHub Copilot.<\/span><\/li>\n<li style=\"font-weight: 400\"><b>Solve logic problems<\/b><span style=\"font-weight: 400\"> and process long chains of reasoning coherently.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">These capabilities are transforming sectors such as academic research, software engineering, and quantitative analysis.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Cognitive automation<\/span><\/h3>\n<p><span style=\"font-weight: 400\">It is estimated that by 2027, these models will be able to outperform the best mathematicians in theorem proofs with a probability of around 60%. This opens the door to:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Automate code audits and smart contracts.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Advanced optimizations in quantitative finance.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Research assistants who formulate preliminary hypotheses or experimental designs.<\/span><\/li>\n<\/ul>\n<h2><span style=\"font-weight: 400\">What have reasoning models NOT been used for?\u00a0<\/span><\/h2>\n<p><span style=\"font-weight: 400\">When we leave the purely digital domain, the effectiveness of reasoning models drops.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">In robotics, for example, training a mechanical arm to move precisely in an unpredictable environment requires huge volumes of real-world data and costly trial-and-error cycles.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">The same goes for advanced video editing or the creation of high-quality generative art, where aesthetic intuition and creative \u201ctouch\u201d come into play.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Degradation in very long chains of reasoning<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Although models have improved their chain-of-thought, they continue to lose coherence when a task requires dozens of intermediate steps.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Prompt engineering techniques (chained prompts, task decomposition) help, but add complexity and do not guarantee robust results in all cases.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">Is it worth continuing to invest in AI?<\/span><\/h2>\n<p><span style=\"font-weight: 400\">Companies like Google or OpenAI must decide whether to continue investing in reasoning models despite the rising cost of computing. An alternative could be to diversify your technology portfolio <\/span><b>by targeting other more accessible approaches<\/b><span style=\"font-weight: 400\">, such as federated learning or explainable AI (XAI).<\/span><\/p>\n<p><span style=\"font-weight: 400\">A prolonged slowdown could chill venture investment and slow the ecosystem of startups focused on advanced logic AI.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Bid for talent and resources<\/span><\/h3>\n<p><span style=\"font-weight: 400\">The increase in operating costs also puts pressure on the salaries of specialized engineers. As Big Tech competes to hire elite researchers, <\/span><b>the barriers to entry for smaller companies become virtually insurmountable<\/b><span style=\"font-weight: 400\">.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">How to overcome the \u201cceiling\u201d in reasoning models?\u00a0<\/span><\/h2>\n<h3><span style=\"font-weight: 400\">Modular architectures and composite agents<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Projects like Ember (Nvidia + Google + Foundry) promote <\/span><i><span style=\"font-weight: 400\">pipelines <\/span><\/i><span style=\"font-weight: 400\">where several specialized models collaborate: one manages the logical planning, another the search for external data and a third the verification of results.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">This reduces the load on each person and optimizes the use of resources.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Mixture of Experts (MoE)<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Instead of activating the entire model on each request, MoE architectures invoke only certain \u201cexperts\u201d (subnets) relevant to the task at hand. This allows parameters to be scaled without linearly increasing the inference cost. This is one of the approaches applied in Deepseek.\u00a0<\/span><\/a><\/p>\n<h3><span style=\"font-weight: 400\">Information retrieval and hybrid generation<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Integrating external knowledge bases (<\/span><i><span style=\"font-weight: 400\">retrieval-augmented generation<\/span><\/i><span style=\"font-weight: 400\">) helps <\/span><a href=\"https:\/\/comunicagenia.com\/blog\/sarahs-hallucinations-something-wrong-with-ai\/?lang=en\"><span style=\"font-weight: 400\">minimize hallucinations <\/span><\/a><span style=\"font-weight: 400\">and reduce the need to memorize information in the model itself.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">The system consults documents or databases in real time, thus combining memory and reasoning.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Hardware innovations<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Specialized chips (next-generation TPUs, energy-efficient ARM-based GPUs) promise to multiply performance per watt. Designing sustainable data centers, with liquid cooling and renewable sources, can alleviate the energy bottleneck.<\/span><\/p>\n<h3><span style=\"font-weight: 400\">Paradigms beyond deep learning<\/span><\/h3>\n<p><span style=\"font-weight: 400\">Neuro-symbolic approaches are explored, which combine neural networks with traditional symbolic reasoning engines, and causal models, which aim to understand cause-effect relationships rather than pure statistical correlations.<\/span><\/p>\n<h2><span style=\"font-weight: 400\">Between worry and hope<\/span><\/h2>\n<p><span style=\"font-weight: 400\">AI reasoning models have raised the level of what we understand by artificial \u201cintelligence\u201d, conquering challenges that only a few years ago seemed unattainable.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">However, reports from Epoch AI and signs of diminishing returns warn us that advances based solely on increasing size and compute <\/span><b>could peak in the next 12 to 24 months.<\/b><\/p>\n<p><span style=\"font-weight: 400\">However, the outlook is not completely bleak. Research in modular architectures, MoE techniques, hybrid external memory systems and the development of increasingly efficient hardware offer promising routes to extend the improvement curve.<\/span><\/p>\n<p><span style=\"font-weight: 400\">The next chapter of reasoning AI is already underway: it will be written with smarter approaches, not just bigger ones.<\/span><\/p>\n<p><span style=\"font-weight: 400\">The question is whether this additional intelligence will arrive in time to avoid the \u201cbump\u201d that is coming, <\/span><b>or if we will have to adapt to a stage of slower, but perhaps more sustainable advances<\/b><span style=\"font-weight: 400\">. Under this new logic, the real challenge will no longer be \u201ccan they think like us?\u201d, but \u201chow can we make them think better and with fewer resources?\u201d<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Imagine a world where machines not only calculate, but also reason in a way analogous to a human being: solving complex equations, proving theorems or generating flawless code instantly.\u00a0 Today, this dream is a reality thanks to AI reasoning models, which have established themselves as essential tools in fields as diverse as mathematical research or [&hellip;]<\/p>\n","protected":false},"author":9,"featured_media":18588,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","_thinkrank_schema_form_data":"","_thinkrank_selected_schema_type":"","_thinkrank_additional_schemas":"","_thinkrank_canonical_url":"","_thinkrank_og_title":"","_thinkrank_og_description":"","_thinkrank_og_image":"","_thinkrank_twitter_title":"","_thinkrank_twitter_description":"","_thinkrank_twitter_image":"","_thinkrank_imported_from":"","_thinkrank_focus_keywords":[],"_thinkrank_focus_keyword":"","_thinkrank_robots_meta_enabled":0,"_thinkrank_robots_meta":"","_thinkrank_advanced_robots_meta":"","_thinkrank_exclude_from_search":0,"_thinkrank_exclude_from_archives":0,"_thinkrank_primary_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[719],"tags":[],"class_list":["post-25330","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence"],"uagb_featured_image_src":{"full":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite.jpg",1408,768,false],"thumbnail":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite-150x150.jpg",150,150,true],"medium":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite-300x164.jpg",300,164,true],"medium_large":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite-768x419.jpg",768,419,true],"large":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite-1024x559.jpg",1024,559,true],"1536x1536":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite.jpg",1408,768,false],"2048x2048":["https:\/\/comunicagenia.com\/wp-content\/uploads\/2025\/05\/modelos-razonamiento-ia-limite.jpg",1408,768,false]},"uagb_author_info":{"display_name":"marketing","author_link":"https:\/\/comunicagenia.com\/en\/blog\/author\/marketing\/"},"uagb_comment_info":0,"uagb_excerpt":"Imagine a world where machines not only calculate, but also reason in a way analogous to a human being: solving complex equations, proving theorems or generating flawless code instantly.\u00a0 Today, this dream is a reality thanks to AI reasoning models, which have established themselves as essential tools in fields as diverse as mathematical research or&hellip;","_links":{"self":[{"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/posts\/25330","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/comments?post=25330"}],"version-history":[{"count":0,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/posts\/25330\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/media\/18588"}],"wp:attachment":[{"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/media?parent=25330"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/categories?post=25330"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/comunicagenia.com\/en\/wp-json\/wp\/v2\/tags?post=25330"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}