US e-commerce giant Amazon.com Inc. has announced a team-up between its cloud computing arm and French-American artificial intelligence (AI) startup Hugging Face Inc. to simplify operations of thousands of large language models (LLMs) on the online retailer’s bespoke computing chips.
The partnership is set to focus on addressing developers’ need to use AI models to power software applications on Amazon Web Services’ (AWS) specialized chip, Inferentia 2.
Hugging Face has provided developers with a platform for finding and customizing open-source LLMs such as Meta Platforms Inc.’s Llama 3. However, developers often want to deploy the custom AIs to run software.
Hugging Face Product Director Jeff Boudier said the collaboration aims to ‘democratize access’ to significant AI systems by easing the financial challenges of operating complex models.
The collaboration between the two companies highlights a larger trend in the tech sector of further involving AI with cloud services.
With Amazon’s chips, the New York City-based startup can optimize performance and cut costs for users, potentially providing it more momentum to innovate and adopt AI.
AWS expects the team-up to further AI developers’ interest in using its cloud services to deploy AI.
AWS Vice President of Product Matt Wood stated that Inferentia 2 is designed to improve the efficiency and cost-effectiveness of AI inference.
AI darling Nvidia Corp. has taken the lead in the LLM training market, but the cloud division of Seattle-based Amazon is trying to position its chips as a better choice for handling high-frequency inference tasks.
While training models can be done once a month, inference against them can occur thousands of times per hour, according to Wood, who suggested that AWS’s chips can operate such AI tools at lower cost over time.
The move also signals the US tech giant’s aim to further solidify its position in the AI industry, challenging other cloud companies by offering hardware services focused on handling various AI tasks.
Additionally, partnerships similar to AWS and Hugging Face might significantly impact the future of AI and cloud computing, considering AI’s continued advancement and growth.
Quick Look: Alnylam's stock surged 38% to $225.35 after positive study results for its heart…
Quick Look: Belgium introduces a new digital ID wallet, secured by Cryptomathic, aligning with EU…
On Monday, sources claim that the Microsoft deal to invest in G42 is said to…
On Monday, Nvidia shares dropped 6.70% lower, lengthening their losses for a third consecutive period,…
Oil prices were steady on Tuesday as traders assessed concerns over China’s rebound outlook and…
Quick Look: Analyst Ratings: Denali Therapeutics holds a "Moderate Buy" with an average target price…
This website uses cookies.