Google's HEIR Aims to Make Homomorphic-Encrypted Inference a One-Click Capability

Google is introducing HEIR (Homomorphic Encryption Intermediate Representation), an open-source compiler and development toolchain designed to make encrypted computation easier to deploy. In particular, HEIR can compile pre-trained AI models built for conventional, unencrypted inputs so they can instead operate on encrypted data.

Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens

Shopify’s engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned “gist” tokens, improving throughput and reducing inference cost.

Google Mantis: An Agentic Vulnerability Scanning Harness for Reducing False Positives

Google has open-sourced Mantis, an AI-agent framework designed to automate the software vulnerability lifecycle, from identifying and validating vulnerabilities to reproducing and fixing them. Google says it developed Mantis to address the high rate of false positives and hallucinated vulnerabilities produced by conventional AI-powered code scanning.