Cyber Index

Benchmark evaluating a model's ability to reproduce real vulnerabilities in open-source software and subsequently patch them; Mistral Large 4 scored 82%.

Mistral Unveils 'Le Chonk': Mistral Large 4 Debuts on Hugging Face with Massive Cybersecurity and Coding Capabilities