Latest news with #Lemberger
Techday NZ
23-05-2025
- Business
- Techday NZ
PEAK:AIO unveils platform to tackle AI memory bottlenecks
PEAK:AIO has introduced a dedicated solution designed to unify KVCache acceleration and GPU memory expansion for large-scale artificial intelligence workloads, focusing on addressing memory bottlenecks in large language model inference and model development. The company's new platform, powered by CXL memory and integrated with Gen5 NVMe and GPUDirect RDMA, is positioned to provide up to 150 GB/sec sustained throughput with latency below five microseconds. This solution aims to support the growing demands of inference tasks, agentic systems, and model creation processes in AI deployments. Eyal Lemberger, Chief AI Strategist and Co-Founder of PEAK:AIO, described the current landscape of AI memory requirements as evolving beyond static prompts toward more complex workloads: "Whether you are deploying agents that think across sessions or scaling toward million-token context windows, where memory demands can exceed 500GB per model, this appliance makes it possible by treating token history as memory, not storage. It is time for memory to scale like compute has." As artificial intelligence models, particularly transformer-based architectures, increase in size and context, AI pipelines are encountering two main barriers: inefficiency with KVCache and saturation of GPU memory resources. According to the company, other vendors have attempted to adapt existing storage technologies or extend NVMe use to delay these limitations. The platform from PEAK:AIO, referred to as the 1U Token Memory Platform, adopts a token-centric architecture built specifically for scalable artificial intelligence. The company states that this approach allows KVCache reuse across multiple sessions, models, and nodes, along with expanded context windows for longer model history, GPU memory offload using CXL, and low latency access by means of RDMA over NVMe-oF. This platform diverges from traditional NVMe-based storage solutions by providing infrastructure that treats token memory as a primary resource rather than storing it as files. Teams are thus able to cache token history, attention maps, and streaming data at memory-like latency, which the company says is consistent with the performance requirements of advanced AI deployments. PEAK:AIO's system is designed to align specifically with NVIDIA's KVCache reuse and memory management frameworks, providing direct support for users employing TensorRT-LLM or Triton, which the company claims results in accelerated inference speeds with minimal integration work. Leveraging CXL for memory-class performance, the platform delivers token memory operations with characteristics similar to RAM. Lemberger commented further on the design philosophy behind the platform: "While others are bending file systems to act like memory, we built infrastructure that behaves like memory, because that is what modern AI needs. At scale, it is not about saving files; it is about keeping every token accessible in microseconds. That is a memory problem, and we solved it at embracing the latest silicon layer." The solution is fully software-defined and can be deployed on off-the-shelf servers. The company anticipates entering production by the third quarter. PEAK:AIO will be making early access and technical consultations available for organisations interested in integrating the platform within their own AI infrastructure. Mark Klarzynski, Co-Founder and Chief Strategy Officer at PEAK:AIO, highlighted the technical approach adopted by the company: "The big vendors are stacking NVMe to fake memory. We went the other way, leveraging CXL to unlock actual memory semantics at rack scale. This is the token memory fabric modern AI has been waiting for."
Yahoo
28-01-2025
- Business
- Yahoo
Shade Mountain Winery recipient of several awards at PA Farm Show
Jan. 28—MIDDLEBURG — Wines produced at Middleburg's family-owned Shade Mountain Winery and Vineyard received several awards at this year's Pennsylvania Farm Show in Harrisburg. The 25-year-old business was awarded Best of Show for its Gewurztraminer wine, a dry German white wine it began making about eight years ago. Another gold medal was awarded for the Lemberger, a semi-dry, German red wine and a silver medal for the Dry Rosѐm a blend of Cabernet Franc and Cayuga grapes. kAm"xE'D 2 8C62E H2J E@ D9@H42D6 @FC H:?6D 2?5 C6249 A6@A=6[" y6??:76C +:>>6C>2? }:4@=2 D2:5 @7 E96 H:?6CJ'D 2EE6?52?46 2E E96 72C> D9@H] "(6 2C6 E9C@F89 2?5 E9C@F89 28] (6 8C@H @FC @H? 8C2A6D 2?5 3682? 2D 2 H@C]"k^Am kAm%96 f_\24C6 72C> AC@5F46D c_ G2C:6E:6D @7 8C2A6D[ :?4=F5:?8 r236C?6E $2FG:8?@?[ r236C?6E uC2?4[ !:?@E }@:C[ |6C=@E[ !:?@E vC:8:@[ r92C5@??2J[ ':@8?:6C[ vCü?6C '6=E=:?6C[ %C2>:?6EE6[ #:6D=:?8 2?5 }:282C2]k^Am kAm$9256 |@F?E2:? (:?6CJ 2=D@ @776CD 2? 6IE6?D:G6 =:DE @7 7CF:E H:?6D[ 2== 4C27E65 FD:?8 =@42==J 8C@H? AC@5F46[ 2?5 2 =:?6 @7 DA2C2J 36 D2>A=65 2?5 AFC492D65 2E E96 H:?6CJ 2?5 G:?6J2C5 @? #@FE6 '_c 2?5 2E db sU2>Ajw pG6?F6 :? s2?G:==6]k^Am
