Meta Reveals New AI Image Generation Model CM3leon, Touting Greater Efficiency

VentureBeat2023-07-17

Credit: VentureBeat made with MidjourneyMeta is continuing to push forward with its research into new forms of generative AI models, today revealing its latest effort known as CM3leon (pronounced like...

Source Link

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Comments

We need your insight to fill this gap

Leave a comment

{"i18n":{"language":"en_US"},"isChannel":false,"data":{"share":"https://ttm.financial/m/news/1127132695?lang=en_US&edition=fundamental","thumbnail":"","is_english":true,"pubTime":"2023-07-17 16:21","share_image_url":"https://static.laohu8.com/e9f99090a1c2ed51c021029395664489","id":"1127132695","market":"us","top_or_hot":-1,"title":"Meta Reveals New AI Image Generation Model CM3leon, Touting Greater Efficiency","media":"VentureBeat","content":"<div>\n<p>Credit: VentureBeat made with MidjourneyMeta is continuing to push forward with its research into new forms of generative AI models, today revealing its latest effort known as CM3leon (pronounced like...</p>\n\n<a href=\"https://venturebeat.com/ai/meta-reveals-new-ai-image-generation-model-cm3leon-touting-greater-efficiency/\">Source Link</a>\n\n</div>\n","source":"lsy1635982906095","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>Meta Reveals New AI Image Generation Model CM3leon, Touting Greater Efficiency</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 11px; color: #7E829C; margin: 0;line-height: 11px;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\nMeta Reveals New AI Image Generation Model CM3leon, Touting Greater Efficiency\n</h2>\n\n<h4 class=\"meta\">\n\n\n2023-07-17 16:21 GMT+8&nbsp;&nbsp;&nbsp;<a href=https://venturebeat.com/ai/meta-reveals-new-ai-image-generation-model-cm3leon-touting-greater-efficiency/><strong>VentureBeat</strong></a>\n\n\n</h4>\n\n</header>\n<article>\n<div>\n<p>Credit: VentureBeat made with MidjourneyMeta is continuing to push forward with its research into new forms of generative AI models, today revealing its latest effort known as CM3leon (pronounced like...</p>\n\n<a href=\"https://venturebeat.com/ai/meta-reveals-new-ai-image-generation-model-cm3leon-touting-greater-efficiency/\">Source Link</a>\n\n</div>\n\n\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"META","symbol_name":"Meta Platforms, Inc.","start_time":0,"source_url":"https://venturebeat.com/ai/meta-reveals-new-ai-image-generation-model-cm3leon-touting-greater-efficiency/","article_id":"1127132695","we_media_id":null,"thumbnails":[],"rights":null,"url":"https://stock-news.laohu8.com/highlight/detail?id=1127132695","pubTimestamp":1689582105,"sourceInfo":{"source_id":"lsy1635982906095","name":"VentureBeat"},"weMediaInfo":null,"summary":"Credit: VentureBeat made with MidjourneyMeta is continuing to push forward with its research into new forms of generative AI models, today revealing its latest effort known as CM3leon (pronounced like","collect":0,"end_time":0,"defaultTopTitle":"venturebeat.com","property":[],"viewcount":null,"language":"en","relate_stocks":{"META":"Meta Platforms, Inc."},"translate_title":"Meta揭示了新的人工智能图像生成模型CM3leon，吹捧更高的效率","themeId":"0b6ff676e0fb47acb494889770087876","isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"META":1.1},"content_text":"Credit: VentureBeat made with MidjourneyMeta is continuing to push forward with its research into new forms of generative AI models, today revealing its latest effort known as CM3leon (pronounced like “chameleon”).CM3leon is a multimodal foundation model for text-to-image creation, as well as image-to-text creation, which is useful for automatically generating captions for images.AI generated images are obviously not a new concept at this point, with popular tools like Stable Diffusion, DALL-E and Midjourney that are widely available. What is new are the techniques Meta is using to build CM3leon and the performance that Meta claims the foundation model is able to achieve.Text-to-image generation technologies today largely rely on the use of diffusion models (where Stable Diffusion gets its name from) to create an image. CM3leon is using something different: a token-based autoregressive model.“Diffusion models have recently dominated image generation work due to their strong performance and relatively modest computational cost,” Meta research wrote in a research paper titled Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning. “In contrast, token-based autoregressive models are known to also produce strong results, with even better global image coherence in particular, but are much more expensive to train and use for inference.”What Meta researchers have been able to do with CM3leon is actually demonstrate how the token-based autoregressive model can, in fact, be more efficient than a diffusion model based approach.“CM3leon achieves state-of-the-art performance for text-to-image generation, despite being trained with five times less compute than previous transformer-based methods,” Meta researcher wrote in a blog post.Meta’s ‘ethical’ approach to image trainingThe basic outline of how CM3leon works is somewhat similar to how existing text generation models work.Meta researchers started with a retrieval-augmented pre-training stage. Rather than just scraping publicly available images off the internet, which is a method that has caused some legal challenges for diffusion-based models, Meta has taken a different path.“The ethical implications of image data sourcing in the domain of text-to-image generation have been a topic of considerable debate,” the Meta research paper states. “In this study, we use only licensed images from Shutterstock. As a result, we can avoid concerns related to image ownership and attribution, without sacrificing performance.”After the pre-training, the CM3leon model goes through a supervised fine-tuning (SFT) stage that Meta researchers claim produces highly optimized results, both in terms of resource utilization as well as image quality. SFT is an approach that is used by OpenAI to help train ChatGPT. Meta notes in its research paper that SFT is used to train the model to understand complex prompts which is useful for generative tasks.“We have found that instruction tuning notably amplifies multi-modal model performance across various tasks such as image caption generation, visual question answering, text-based editing, and conditional image generation,” the paper states.Looking at the sample sets of generated images that Meta has shared in its blog post about CM3leon, the results are impressive and clearly show the model’s ability to understand complex, multi-stage prompts, generating extremely high resolution images as a result.Currently CM3leon is a research effort and it’s not clear when or even if Meta will make this technology publicly available in a service on one of its platforms. Given how powerful it seems to be, and the higher efficiency of generation, it does see highly likely that CMleon and its approach to generative AI will move beyond research (eventually).","kind":null,"is_publish_news":true,"is_publish_highlight":true,"is_publish_live":false,"is_publish_wemedia":null,"editions":null,"column":"","sentiment":"0","news_tag":"","news_rank":0,"symbols":[],"gpt_button":1},"commentList":[],"isCommentEnd":true,"newsSizeData":{"likeSize":15,"commentSize":0,"repostSize":0,"favoriteSize":0,"likeStatus":false,"favoriteStatus":false},"APP":{"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","isDev":false,"isTTM":true,"deviceId":"web-server-community-laohu8-v3","version":"4.29.2","shortVersion":"4.29.2","platform":"web","vendor":"web","appName":"ttm","isIOS":false,"isAndroid":false,"isTiger":false,"isTHS":false,"isWeiXin":false,"isWeiXinMini":false,"isWeiBo":false,"isQQ":false,"isBaiduSwan":false,"isBaiduBox":false,"isDingTalk":false,"isToutiao":false,"isOnePlus":false,"isHuaWei":false,"isXiaomi":false,"isXiaomiWebView":false,"isOppo":false,"isVivo":false,"isSamsung":false,"isMobile":false},"href":"/m/news/1127132695"}