SiMa.ai’s Palette 3.0 runs many AI models on one chip and lifts throughput up to 3.5 times
Coverage 2 sources · 2 reports · 2C
Chronological — read the same story from every side and decide for yourself.
-
SiMa.ai’s Palette 3.0 runs many AI models on one chip and lifts throughput up to 3.5 times
Physical artificial intelligence chip startup SiMa Technologies Inc. today released Palette 3.0, a new version of its Palette software suite intended to allow many AI models to run concurrently on one chip. According to the company, the release, which builds on the Palette Neat agentic development environment launched in June, can raise model throughput by […] The post SiMa.ai’s Palette 3.0 runs many AI models on one chip and lifts throughput up to 3.5 times appeared first on SiliconANGLE .
-
SiMa.ai says Palette 3.0 makes LLMs on its chips up to 3.5x faster
SiMa.ai has released Palette 3.0, the next version of the software for its Modalix AI chips. The San Jose start-up says language models on the chip now generate text up to 3.5 times faster. Power draw stays broadly the same. The gain comes from speculative decoding. A small, fast draft model proposes several tokens at […] This story continues at The Next Web
Discussion 0 comments