The Linux Foundation Projects
Skip to main content

DeepRec Joins LF AI & Data as New Sandbox Project

By May 11, 2023No Comments

LF AI & Data Foundation—the organization building an ecosystem to sustain open source innovation in artificial intelligence (AI) and data open source projects, today is announcing DeepRec as its latest Sandbox Project.

Dr. Ibrahim Haddad, Executive Director of LF AI & Data, said: “I am thrilled to welcome DeepRec to the LF AI & Data community. With its impressive track record in deep-learning recommendation frameworks, DeepRec is poised to bring innovative solutions to our portfolio of technical projects. We are excited to collaborate with the DeepRec community to further develop and enhance this powerful open source technology. Together, we can leverage the expertise and resources of the LF AI & Data community to drive advancements in deep learning and revolutionize the way we approach recommendation systems.”

DeepRec is a high-performance recommendation deep learning framework that was founded and open sourced by the Machine Learning Platform for AI (PAI) of Alibaba Cloud, the digital technology and intelligence backbone of Alibaba Group. Firstly, DeepRec provides higher performance for recommendation models in training and inference, which has a super large-scale distributed training capability that supports training recommendation models with over a trillion samples and ten trillion parameters. Secondly, it provides easier deployment for huge recommendation models over 10TB and supports online deep learning with huge recommendation models at a minute or less. Thirdly, it provides better (AUC) which can be brought by embedding and optimizer features in DeepRec which could significantly improve business performance and brings immense commercial value for retailing, media, advertisements, and social media platforms.

DeepRec is widely used in Alibaba’s businesses including Taobao, Tmall, AliExpress, Lazada, etc. It supports core businesses such as Taobao search, recommendation, and advertising. In addition, DeepRec has been open-sourced for more than a year and has been used in dozens of companies’ search and promotion business scenarios, bringing tangible business value to enterprise customers.

Lin Wei, senior director of Alibaba Cloud’s machine learning platform PAI and big data platform, said: “We are excited to join the Linux Foundation AI&Data community. By bringing in our latest innovative technology, we hope to make more contributions to the open-source AI and big data community moving forward.”

This project aims to be governed openly and transparently so that it is accessible to the broader community. Therefore, all individuals are welcome to participate in this project, regardless of their corporate affiliations.

LF AI & Data supports projects via a wide range of services, and the first step is joining as a Sandbox Project. Learn more about DeepRec on their GitHub and join the DeepRec-Announce Mailing List.

A warm welcome to DeepRec! We are excited to see the project’s continued growth and success as part of the LF AI & Data Foundation. If you are interested in hosting an open source project with us, please visit the LF AI & Data website to learn more.

DeepRec Key Links

LF AI & Data Resources