Snowflake, Inc. SNOW shares are trading higher on Tuesday. The company announced today that it will partner with Meta META to host its Llama 3.1 collection of multilingual open source large language models (LLMs) in Snowflake Cortex AI.
What Happened: Snowflake’s AI Research team optimized Llama 3.1 for both inference and fine-tuning, providing a 128K context window, up to 3x lower latency and 1.4x higher throughput compared to existing solutions.
“Snowflake’s world-class AI Research Team is blazing a trail for how enterprises and the open source community can harness state-of-the-art open models like Llama 3.1 405B for inference and fine-tuning in a way that maximizes efficiency,” said Vivek Raghunathan, vice president of AI engineering at Snowflake.
Alongside the launch of Llama 3.1 405B, Snowflake’s AI Research Team is open-sourcing its advanced LLM inference and fine-tuning optimization stack, developed in collaboration with DeepSpeed, Hugging Face, vLLM and the AI community.
This software is designed to address issues related to memory requirements and model scale, and by making it open source, it will be accessible to a broader range of users.
Related Link: Verizon Postpaid Net Adds Decline, But Broadband Growth Is ‘Close To The Best’: Analyst
SNOW Price Action: At the time of writing, Snowflake stock is moving 1.42% higher at $133.01 per data from Benzinga Pro.
Image: Photo via Shutterstock
© 2024 Benzinga.com. Benzinga does not provide investment advice. All rights reserved.
Comments
Trade confidently with insights and alerts from analyst ratings, free reports and breaking news that affects the stocks you care about.