{"id":16901,"date":"2024-07-12T06:15:55","date_gmt":"2024-07-12T04:15:55","guid":{"rendered":"https:\/\/tech4future.info\/?p=16901"},"modified":"2024-07-12T07:18:21","modified_gmt":"2024-07-12T05:18:21","slug":"learning-general-purpose-robots","status":"publish","type":"post","link":"https:\/\/tech4future.info\/en\/learning-general-purpose-robots\/","title":{"rendered":"Robotic learning: will it be possible to train general-purpose and multi-use robots in the future?"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Robotic learning is a field within robotics focused on artificial intelligence techniques (particularly machine learning) that enable machines, from the simplest to the most advanced, to acquire specific&nbsp;<strong>skills and competencies<\/strong>&nbsp;based on the environment they are placed in and the tasks they are required to perform. These skills and competencies range from those related to motor areas, spatial perception, and manipulation, to more complex ones such as object recognition and classification, language comprehension, and human interaction.<strong><\/strong><\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u00ab<em>Robots are excellent specialists but poor generalists. Typically, a model needs to be trained for each activity and environment. Changing a single variable often requires starting from scratch.&nbsp;<\/em><strong><em>But what if we could combine all robotics knowledge and define a way to train a multipurpose robot?<\/em><\/strong><em>\u00bb.<\/em><\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">This question was posed by the team of robotic engineers at Google DeepMind before they created, in October 2023, with the collaboration of thirty-three academic laboratories worldwide,\u00a0<a href=\"https:\/\/deepmind.google\/discover\/blog\/scaling-up-learning-across-many-different-robot-types\/\" target=\"_blank\" rel=\"noreferrer noopener\">an unprecedented open dataset for the research community. This dataset contains training data for twenty-two different types of robots<\/a>.\u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The aim is to&nbsp;<strong>develop<\/strong>, from a large and heterogeneous dataset sourced from various research institutes and machines,&nbsp;<strong>a &#8220;generalist&#8221; and versatile learning model that enables multiple types of robots to acquire various skills<\/strong>.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-text-color has-link-color wp-elements-1\" id=\"h-takeaways\" style=\"color:#73cc49\"><strong>TAKEAWAYS<\/strong><\/h2>\n\n\n\n<div class=\"wp-block-uagb-icon-list uagb-block-b2c519bd\"><div class=\"uagb-icon-list__wrap\">\n<div class=\"wp-block-uagb-icon-list-child uagb-block-a075852d\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">In a recently updated work, Google DeepMind emphasises the need to move beyond conventional robotic learning methods, shifting towards a generalist policy that can be adapted to new machines, tasks, and environments.<\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-icon-list-child uagb-block-8292601c\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">The Computer Science and Artificial Intelligence Laboratory at MIT also addresses this topic, proposing a training method for multipurpose robots based on a combination of data from various sources, supported by a generative AI technique.<\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-icon-list-child uagb-block-5f246575\"><span class=\"uagb-icon-list__source-wrap\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M256 0C114.6 0 0 114.6 0 256c0 141.4 114.6 256 256 256s256-114.6 256-256C512 114.6 397.4 0 256 0zM406.6 278.6l-103.1 103.1c-12.5 12.5-32.75 12.5-45.25 0s-12.5-32.75 0-45.25L306.8 288H128C110.3 288 96 273.7 96 256s14.31-32 32-32h178.8l-49.38-49.38c-12.5-12.5-12.5-32.75 0-45.25s32.75-12.5 45.25 0l103.1 103.1C414.6 241.3 416 251.1 416 256C416 260.9 414.6 270.7 406.6 278.6z\"><\/path><\/svg><\/span><span class=\"uagb-icon-list__label\">In a future scenario, having robots capable of performing tasks they have never been trained for, and adapting to new duties in workplaces &#8211; particularly in assisting non-self-sufficient individuals &#8211; would provide valuable support, especially in emergencies and hazardous situations for the assisted person.<\/span><\/div>\n<\/div><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-generalist-robotic-learning\"><strong><strong>Generalist robotic learning<\/strong><\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The article &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/2310.08864\" target=\"_blank\" rel=\"noreferrer noopener\">Open X-Embodiment: Robotic learning datasets and RT-X models<\/a>&#8221; is the manifesto of Google DeepMind&#8217;s research. First published in Computer Science on 13 October 2023 and updated on 1 June 2024, the article outlines the group&#8217;s initial hypothesis: to transcend\u00a0\u00ab<em>conventional robotic learning methods that train a model for each application and environment, and instead move\u00a0<\/em><strong><em>towards a generalist policy<\/em><\/strong><em>\u00a0that can be efficiently adapted to new robots, tasks, and environments<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The dataset, named&nbsp;<strong>Open X-Embodiment<\/strong>, includes training data from thirty-three global robotics research centres. This data encompasses&nbsp;<strong>527 skills, 160,266 tasks<\/strong>, and&nbsp;<strong>over one million trajectories&nbsp;<\/strong>of twenty-two already designed and existing robots, ranging from single robotic arms to dual-arm robots and quadruped models.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<em>Although most skills belong to the pick-place family, the long tail of the dataset also contains skills such as &#8216;erase&#8217; or &#8216;assemble&#8217;. Moreover, the data covers a wide range of household objects, from appliances to food and utensils<\/em>\u00bb,&nbsp;explain the researchers.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-parallels-with-research-in-the-field-of-artificial-vision\"><strong>Parallels with research in the field of Artificial Vision<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Google DeepMind&#8217;s project is comparable to developments in the artificial vision sector approximately fifteen years ago, with the creation of the&nbsp;<strong>largest online dataset of real images<\/strong>&nbsp;ever (<strong>ImageNet<\/strong>). This dataset contains over fourteen million labelled video data points classified into more than twenty thousand categories, significantly advancing image classification research.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<em>Recent major advancements in various segments of machine learning research, such as computer vision and natural language processing, have been enabled&nbsp;<strong>by a common approach&nbsp;<\/strong>that leverages large, diverse datasets<\/em>\u00bb,&nbsp;notes the team.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Although similar approaches have been attempted in robotics, several challenges have emerged, primarily the longstanding&nbsp;<strong>scarcity of real-world robotic data<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<em>Data collection is particularly costly and demanding for robotics<\/em>\u00bb,&nbsp;explain the researchers,&nbsp;\u00ab<em>as it requires highly intensive engineering operations or alternatively, precise and meticulous video recordings<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Another critical issue is the lack of scalable models that can learn from such data and, consequently, perform effective generalisations [source: \u201c<a href=\"https:\/\/research.google\/blog\/rt-1-robotics-transformer-for-real-world-control-at-scale\/\" target=\"_blank\" rel=\"noreferrer noopener\">RT-1: Robotics Transformer for real-world control at scale<\/a>\u201d &#8211; Google Robotics Research, 13 December 2022].<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-robotics-transformers-trained-on-diverse-data\"><strong>Robotics transformers trained on diverse data<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Google DeepMind&#8217;s robotic engineers tested the Open X-Embodiment dataset by training two&nbsp;<strong>Robotics Transformers (RT),<\/strong>&nbsp;defined by them as machine learning models&nbsp;\u00ab<em>capable of generating simple and scalable actions for real-world robotic tasks<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The first Robotics Transformer,&nbsp;<strong>RT-1<\/strong>, was developed for large-scale real-world robotic control, while&nbsp;<strong>RT-2<\/strong>&nbsp;is a vision-language-action model that learns from both web video data and robotic data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Specifically, the first model was trained on data within Open X-Embodiment, including&nbsp;<strong>130,000 episodes related to over 700 robotic activities<\/strong>, collected from a fleet of thirteen Everyday Robots over seventeen months.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Robotics Transformer 1 was tested by the team in five different research labs, yielding results that indicated a&nbsp;\u00ab<strong><em>50% average improvement in success rate<\/em><\/strong><em>&nbsp;across five different commonly used robots, compared to methods independently developed and specific to each robot<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Overall, initial tests of the two robot learning models trained using diverse and cross-referenced data (as opposed to homogeneous and specific data) demonstrated that&nbsp;<strong>they enable robots trained in specific domains to acquire greater skills than conventional learning models.<\/strong><\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-heterogeneous-robotic-learning-through-policy-composition\"><strong>Heterogeneous robotic learning through policy composition<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Recently, the Computer Science and Artificial Intelligence Laboratory (CSAIL) at the Massachusetts Institute of Technology (MIT) revisited the topic of generalist policies for robotic learning with a study titled \u201c<a href=\"https:\/\/arxiv.org\/pdf\/2402.02511\" target=\"_blank\" rel=\"noreferrer noopener\">PoCo: Policy Composition from and for Heterogeneous Robot Learning<\/a>\u201d (arXiv, 27 May 2024).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The study, set to be officially presented at the\u00a0<a href=\"https:\/\/roboticsconference.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">2024 Robotics: Science and Systems Conference in Delft, Netherlands, from 15 to 19 July 2024<\/a>, builds on a thesis already familiar to Google DeepMind engineers:\u00a0\u00ab<strong><em>robots trained with a relatively small amount of task-specific data often cannot perform new tasks in unfamiliar environments<\/em><\/strong>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For example, robots in a warehouse tasked with boxing items cannot perform tasks related to moving items in a production site, as these are two different tasks in different locations, involving different robotic learning policies and, naturally, different training datasets.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Using the warehouse example,&nbsp;\u00ab<em>each generates terabytes of data, but they pertain to a series of specific tasks and skills in that location, including boxing.&nbsp;<strong>Thus, they are not ideal for training a generic machine<\/strong><\/em>\u00bb,&nbsp;note the MIT researchers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To overcome this issue, the team developed&nbsp;<strong>a framework for training multipurpose robots<\/strong>&nbsp;based on a combination of data from various sources.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Essentially, the framework, named Policy Composition (PoCo), utilises numerous small datasets (such as those collected from multiple robotic warehouses),&nbsp;\u00ab<strong><em>from which it learns separate policies that are then combined,<\/em><\/strong><em>&nbsp;enabling a robot to make generalisations across multiple tasks<\/em>\u00bb.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-role-of-generative-ai-and-diffusion-models\"><strong>The role of generative AI and diffusion models<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">At the core of the Policy Composition method for robotic learning lies a generative artificial intelligence technique known as &#8220;<strong>Diffusion Models<\/strong>.&#8221; This technique enables the integration of multiple data sources spread across various domains, modalities, and activities.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It is important to note that Diffusion Models (also known as &#8220;probabilistic diffusion models&#8221; or &#8220;score-based generative models&#8221;) fall under the category of machine learning techniques. Their objective is to learn a diffusion process that generates a set of probabilities\u00a0<strong>for a given dataset<\/strong> [source: Diffusion Models:\u00a0<a href=\"https:\/\/arxiv.org\/pdf\/2209.00796\" target=\"_blank\" rel=\"noreferrer noopener\">A Comprehensive Survey of Methods and Applications<\/a>\u00a0&#8211; arXiv, 24 June 2024].<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The authors further explain that these generative AI models are often employed in image generation. However, in the context of this research,&nbsp;\u00ab<em>they are taught to generate trajectories for robots. They accomplish this by adding noise to the training data, then gradually removing the noise to refine the output, thus generating a trajectory<\/em>\u00bb.&nbsp;Policy Composition is fundamentally based on this &#8220;<strong>Diffusion Policy<\/strong>&#8221; work.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The PoCo approach involves&nbsp;<strong>training a single model at a time<\/strong>, using a different video dataset for each instance. This dataset might include images related to&nbsp;<strong>demonstrations<\/strong>&nbsp;of specific tasks, featuring humans and robots, images gathered&nbsp;<strong>during real-world activities<\/strong>&nbsp;conducted by a remotely controlled robotic arm, or data derived from&nbsp;<strong>robotic task simulations<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Within this methodology, each Diffusion Model&#8217;s role is to learn a specific robotic policy from the training data that enables the completion of a particular task. Once multiple models have been trained, the individual policies learned are &#8220;combined&#8221; to form&nbsp;<strong>a single, overarching policy<\/strong>&nbsp;that allows a robot to perform various tasks in diverse contexts.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u00ab<em>One of the&nbsp;<strong>advantages<\/strong>&nbsp;of this robotic learning technique<\/em>\u00bb,<em>&nbsp;<\/em>explains the CSAIL team<em>,&nbsp;<\/em>\u00ab<em>is that&nbsp;<strong>we can combine the different obtained policies to harness the best from each machine<\/strong>. For instance, a policy based on real-world data might help robots develop greater dexterity, while one based on simulation could lead them to better generalisation<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In both\u00a0<strong>simulations<\/strong>\u00a0and\u00a0<strong>real-world experiments<\/strong> &#8211; where robotic arms performed tasks using tools such as spatulas, knives, wrenches, and hammers, like hammering a nail or retrieving food from a tray &#8211; the developed robotic learning approach enabled a single robot to execute numerous tasks with previously unused tools and adapt to tasks not learned during training. This resulted\u00a0<strong>in a 20% performance improvement<\/strong>\u00a0compared to basic learning techniques that utilise simple machine learning.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1160\" height=\"1033\" src=\"data:image\/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==\" alt=\"Immagine che illustra l\u2019utilizzo di strumenti quali spatole, coltelli, chiavi inglesi e martelli nelle policy di apprendimento robotico generaliste, in presenza di disturbi esterni (l\u2019intervento di una mano umana) (a) e distrattori (oggetti che si deformano e illuminazione calante) (b), attraverso diverse configurazioni iniziali che richiedono azioni di forza (c) e riarrangiamenti dinamici delle scene (d). L&amp;apos;asse orizzontale mostra la dimensione temporale per ciascuna traiettoria eseguita dal robot [credit: \u201cPoCo: Policy Composition from and for Heterogeneous Robot Learning\u201d - CSAIL Massachusetts Institute of Technology - https:\/\/arxiv.org\/pdf\/2402.02511].\" class=\"wp-image-16788 lazyload\" style=\"width:519px;height:auto\" sizes=\"auto, (max-width: 1160px) 100vw, 1160px\" data-src=\"https:\/\/tech4future.info\/wp-content\/uploads\/2024\/06\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-schema.png\" data-srcset=\"https:\/\/tech4future.info\/wp-content\/uploads\/2024\/06\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-schema.png 1160w, https:\/\/tech4future.info\/wp-content\/uploads\/2024\/06\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-schema-300x267.png 300w, https:\/\/tech4future.info\/wp-content\/uploads\/2024\/06\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-schema-1024x912.png 1024w, https:\/\/tech4future.info\/wp-content\/uploads\/2024\/06\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-schema-768x684.png 768w\"><figcaption class=\"wp-element-caption\">Use of tools such as spatulas, knives, wrenches, and hammers in general-purpose robotic learning policies, under external disturbances (human hand intervention) (a) and distractors (deformable objects and diminishing light) (b), through various initial configurations requiring force actions (c) and dynamic scene rearrangements (d). The horizontal axis shows the temporal dimension for each trajectory executed by the robot [credit: &#8220;PoCo: Policy Composition from and for Heterogeneous Robot Learning&#8221; &#8211; CSAIL Massachusetts Institute of Technology &#8211; https:\/\/arxiv.org\/pdf\/2402.02511].<\/figcaption><\/figure>\n<\/div>\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-glimpses-of-futures\"><strong>Glimpses of Futures<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">From the vast and diverse dataset compiled by Google DeepMind, designed to train a generalist robotic learning model, to the numerous smaller training datasets from MIT&#8217;s Computer Science and Artificial Intelligence Lab, which teach specific robotic policies that will eventually form a unified general policy, the objective remains clear: to train&nbsp;<strong>versatile, multipurpose robots for certain applications<\/strong>, surpassing specialised machines that can only perform a limited set of tasks within a single context.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Given that the described robotic learning models still have many limitations and have been presented in a simplified form, let us nonetheless anticipate possible future scenarios. We will use the&nbsp;<strong>STEPS matrix<\/strong>&nbsp;to analyse the impacts of advancements in generalist and multipurpose robot training methodologies from various perspectives.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>S &#8211; SOCIAL:<\/strong>\u00a0in the future, individual robotic arms, dual-armed robots, and quadruped robots capable of performing diverse activities within the same or different environments &#8211; such as picking up a tool, using it, then moving to another task in another section seamlessly &#8211; would be invaluable in workplaces, especially in warehouses and production sites, as well as in the hospitality and construction sectors, and domestic settings. A machine that &#8220;can do everything,&#8221; capable of performing tasks it has never done before, handling tools and objects it has never used, and adapting to duties not covered in its training, would offer comprehensive support. Consider robots assisting the disabled and elderly; their future versatility could provide crucial help in emergencies and dangerous situations, effectively intervening even without prior familiarity.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>T &#8211; TECHNOLOGICAL<\/strong>: the evolution of training systems for multipurpose robots, as described by MIT&#8217;s team, will not only require increasingly diverse data to enhance the performance of generalist machines but will also integrate other machine learning techniques, including those from generative AI and Diffusion Models. Furthermore, the team states,&nbsp;\u00ab<em>this study shows the effectiveness of the Policy Composition method only for short-term tasks, while we believe extending it to a longer time horizon is an interesting direction for future work, as is extending it to different models, such as those trained with Google DeepMind&#8217;s Robotics Transformer<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>E &#8211; ECONOMIC:<\/strong>\u00a0as we have discussed previously, regarding the economic impact of robots in workplaces, there is a contrasting viewpoint to the fear of rising unemployment rates due to increased automation in certain sectors, from automotive to mechanical work and assembly. The focus here is on industries globally experiencing\u00a0<a href=\"https:\/\/www.randstad.com\/workforce-insights\/talent-acquisition\/why-there-a-global-labor-shortage\/\" target=\"_blank\" rel=\"noreferrer noopener\">a general shortage of personnel<\/a>, such as hospitality and small-scale construction. In the future, with the evolution of generalist robot training methods, the presence of multipurpose machines could be strategic, helping to address the lack of human labour.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>P &#8211; POLITICAL:<\/strong>\u00a0safety concerns are the most debated when it comes to robots in workplaces, especially when they operate directly with people, such as in restaurants and private homes. In a future scenario where multipurpose robots work alongside humans in many sectors, it will be crucial to focus on their impact on health and safety.\u00a0<a href=\"https:\/\/healthy-workplaces.osha.europa.eu\/en\/media-centre\/news\/assembly-lines-hospitals-8-case-studies-integrating-collaborative-robots-worker-safety-mind\" target=\"_blank\" rel=\"noreferrer noopener\">The European Agency for Safety and Health at Work has published several case studies on automation in various professional contexts<\/a>, including assembly lines, industrial production, the automotive industry, steel production, plastic product manufacturing, and more. They particularly highlight the importance of risk assessment in companies,\u00a0\u00ab<em>related, for example, to high forces, electricity, crushing, impacts with the machine, and so on. Each risk must then be classified, and safety measures must be adopted as soon as a certain threshold is exceeded. These could include fencing, personal protective equipment, or continuous training courses<\/em>\u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>S &#8211; SUSTAINABILITY:<\/strong>\u00a0the potential future presence of multipurpose robots in various workplaces inevitably raises questions about the environmental impact of the AI enabling such machines. It has been said that\u00a0\u00ab<em>robots are great &#8216;specialists&#8217; and that a learning model must be trained for each activity and environment&#8221; and that &#8220;changing a single variable often requires starting from scratch<\/em>\u00bb,\u00a0while training a multipurpose robot would streamline this process, reducing the computational energy needed for a robot to acquire multiple skills. However, there is a downside. Training machine learning models to enable generalist robots to perform numerous tasks in different environments requires ever-larger amounts of data and hours of training, with inevitable repercussions on energy consumption and the associated carbon footprint. It\u2019s a catch-22. A US study by Energy area analysts on the future electricity load of\u00a0\u00ab<em>social robotification<\/em>\u00bb\u00a0(&#8220;<a href=\"https:\/\/www.aceee.org\/files\/proceedings\/2017\/data\/polopoly_fs\/1.3687904.1501159084!\/fileserver\/file\/790278\/filename\/0036_0053_000029.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Direct and Indirect Impacts of Robots on Future Electricity Load<\/a>&#8220;) estimates that in the United States, by 2025, the energy consumption of robots will increase to 0.5-0.8% of the country&#8217;s total electricity demand.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>From Google DeepMind&#8217;s approach to the framework developed by MIT, the goal remains clear: to define robotic learning policies that train machines to perform a variety of tasks in diverse contexts, moving beyond the concept of a &#8220;specialised robot&#8221;.<\/p>\n","protected":false},"author":9,"featured_media":16900,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[1099],"tags":[],"class_list":["post-16901","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-en"],"acf":[],"modified_by":"Paola Cozzi","uagb_featured_image_src":{"full":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"thumbnail":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-150x150.jpg",150,150,true],"medium":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-300x130.jpg",300,130,true],"medium_large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"1536x1536":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"2048x2048":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"inner-slider":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso.jpg",768,332,false],"featured-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-543x332.jpg",543,332,true],"large-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-524x276.jpg",524,276,true],"medium-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-415x276.jpg",415,276,true],"related-large":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-343x248.jpg",343,248,true],"related-small":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-343x198.jpg",343,198,true],"normal-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-306x198.jpg",306,198,true],"small-blog":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-95x96.jpg",95,96,true],"small-author":["https:\/\/tech4future.info\/wp-content\/uploads\/2024\/07\/apprendimento-robotico-verso-robot-generalisti-e-multiuso-70x70.jpg",70,70,true]},"uagb_author_info":{"display_name":"Paola Cozzi","author_link":"https:\/\/tech4future.info\/en\/author\/paolacozzi\/"},"uagb_comment_info":0,"uagb_excerpt":"From Google DeepMind's approach to the framework developed by MIT, the goal remains clear: to define robotic learning policies that train machines to perform a variety of tasks in diverse contexts, moving beyond the concept of a \"specialised robot\".","meta_box":{"standard":[{"title":"Generalist robotic learning","link":"#h-generalist-robotic-learning"},{"title":"Parallels with research in the field of Artificial Vision","link":"#h-parallels-with-research-in-the-field-of-artificial-vision"},{"title":"Robotics transformers trained on diverse data","link":"#h-robotics-transformers-trained-on-diverse-data"},{"title":"Heterogeneous robotic learning through policy composition","link":"#h-heterogeneous-robotic-learning-through-policy-composition"},{"title":"The role of generative AI and diffusion models","link":"#h-the-role-of-generative-ai-and-diffusion-models"},{"title":"Glimpses of Futures","link":"#h-glimpses-of-futures"}],"content":false,"name":false,"role":false,"type":false,"category":false,"count":false,"btn":false,"link":false,"layout":false,"title":false,"director":false,"user":false,"email":false,"posts":false,"description":false,"form":false,"subtitle":false,"innertitle":false,"background":false},"_links":{"self":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts\/16901","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/comments?post=16901"}],"version-history":[{"count":0,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/posts\/16901\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/media\/16900"}],"wp:attachment":[{"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/media?parent=16901"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/categories?post=16901"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tech4future.info\/en\/wp-json\/wp\/v2\/tags?post=16901"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}