#GPT

Meta and collaborators developed a novel framework to accurately quantify how much language models memorize training data, estimating GPT models store around 3.6 bits per parameter and providing new insights into memorization versus generalization.

Meta introduces Llama Prompt Ops, a Python package that automates the conversion and optimization of prompts for Llama models, easing transition from proprietary LLMs and improving prompt performance.